— -WORi^HNTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




INTERNATIONAL APPUCATION PUBLISHED UNDER-THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 : 
G06F 15A8, G06T 11/00 



Al 



(11) International Publication Number: 
(43) International Publication Date: 



WO 00/33207 

8 June 2000 (08.06.00) 



(21) International Application Number: PCT/US99/28676 

(22) International Filing Date: 3 December 1999 (03.12.99) 



(30) Priority Data: 
60/1 10,840 
60/112,391 
60/123,087 
09/440,317 



3 December 1998 (03.12.98) US 

15 December 1998 (15.12.98) US 

5 March 1999 (05.03.99) US 

12 November 1999 (12.1 1.99) US 



(71) Applicant: Q RESEARCH, INC. [US/US]; 301 West North 
Bend Way. North Bend, WA 98045 (US). 

(72) Inventor: FRISCH, Lucien, G.; Am Braunsacker 1 10, D-50765 
Cologne (DE). 

(74) Agent: KINDNESS, Gary, S.; Christensen O'Connor Johnson 
& Kindness PLLC, Suite 2800, 1420 Fifth Avenue, Seattle, 
WA 98101-2347 (US). 



(81) Designated States: AE, AL, AM. AT, AU. AZ, BA, BB, BG. 
BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK, DM, EE, 
ES. FI. GB. GD. GE. GH, GM. HR, HU, ID, IL, IN, IS, JP, 
KE, KG. KP, KR, KZ. LC. LK. LR. LS. LT, LU, LV. MA. 
MD. MG, MK, MN. MW, MX, NO. NZ, PL. PT. RO, RU, 
SD, SE. SG, SI, SK. SL. TJ, TM, TR, TT, TZ. UA, UG. 
UZ, VN. YU, ZA, ZW, ARIPO patent (GH, GM, KE, LS. 
MW. SD, SL, SZ, TZ. UG, ZW), Eurasian patent (AM. AZ, 
BY. KG. KZ, MD, RU, TJ, TM). European patent (AT. BE, 
CH, CY, DE, DK, ES, FI. FR. GB. GR. IE. IT. LU, MC, 
NL. PT, SE), OAPI patent (BF, BJ. CF. CG. CI, CM. GA. 
GN. GW. ML. MR, NE, SN. TD, TG). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



610 



(54) Title: DIGITAL IMAGE IMPROVEMENT THROUGH GENETIC IMAGE EVOLUTION 
(57) Abstract 

Computer-implemented methods and systems for im- 
proving a digital image using genetic algorithms is provided. 
Child images are evolved from the digital image using either 
predefined template genotypes or genotypes created through 
evolution. A genotype includes a number of genes that may 
each alter an attribute of the digital image such as hue. bright- 
ness, contrast or color saturation. The evolution includes a 
selection process during which the child images are compared 
against a leader image and assigned a fitness rating. Hie fit- 
ness rating is used in the evolution of subsequent generations 
of child genotypes, with each child genotype producing an 
associated child image. The evolution process may continue 
through as many generations as is desired and an improved 
image may be selected at any time during the evolution. Geno- 
types may be saved as independent data files and applied as 
template genotypes to other digital images. The methods and 
systems of die present invention also provide for evolving a 
printer calibration genotype that is used to adjust the image 
for the printing characteristics of a calibrated printer. 
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DIGITAL IMAGE IMPROVEMENT THROUGH GENETIC IMAGE 

EVOLUTION 

Field of the InventioD 

The present nwention is in the field of computer appUcations and, more 
particularly, cortq)uter applications that irtprove the quaUty of digital images. 

Backgroimd of the Invention 

The growing popularity of digital photography and other digital images may 
be based in part on the ability to alter those digital images usmg computer programs. 
For instance, with editing tools cxurently on the market it is possible to selectively 
substitute one color in a digital image for another color, to change the size and shape 
of the digital image, to mcrease or decrease the brightness of the image, or to 
selectively correct the color saturation of an image so that colors appear more or less 
intense. While it is possible in theory to use these digital image editing tools to 
improve the overall quality of a digital image, in practice a high level of skill is 
required — the user must possess a fairly complete understanding of image attributes 
such as hue, brightness, color saturation, resolution, and g amma . Each change to a 
digital image requires an understanding of what to change, how to change it, and what 
eflFect the change may have on other attributes of the digital image. The user must 
expend considerable eflFort to alter the digital image to produce an acceptable image. 
If the user subjectively likes some of the changes made to the image, but not the final 
altered digital image as a whole, the eflFort e>q)ended on that final image may be 
completely lost. Conversely, if the user is satisfied with the final image, each of the 
changes must be remembered and manually repeated for srnular images. 



wo 00/33207 



-2- 



PCT/US99/28676 



In some cases, a change made to one attribute of the digital unage may 
imwittingly introduce unpleasant artifacts in the digital image. The methods of the 
prior art digital image editing tools often takes a "one size fits all" approach to editing 
attributes in the image. For instance, all color, contrast or brightness values in a 
digital image may be increased or decreased by a set value or according to a linear 
relationship such as y = ax + b. Prior art digital image editing tools, therefore, may 
only provide acceptable results to those that are skilled in color theory. 

It would be desirable to have a digital image editing tool that is easily usable 
by a user fi-om novice to expert to evolve a digital image so that it progressively 
becomes subjectively "better" in the eyes of a user. This digital image editing tool 
should be sinq)le to operate, powerfiil in its ability to alter the digital image in 
beneficial ways, and eflBcient. The present invention is directed to providing such a 
digital imaging tool. 

Summary of the Invention 
In accordance with the present invention, corr^uter-implemented methods and 
systems for enhancing a digital image are disclosed. Each image has an associated 
genotype, with the associated genotype having a plurality of genes. Each gene defines 
an attribute of the associated image such as brightness, color saturation, and contrast. 
The genotype may also contain genes that define methods for enhancing the digital 
image. For exan4)le, the gene may define a method for making a global color shift in 
the digital image or applying special eflfects to the digital image. The genotype may 
be a predefined ternplate genotype or may be a genotype that is evolved through a 
selection process described below. 

In accordance with the present invention, the selection process includes 
receiving a fitness rating for each of a plurality of digital images within a current 
generation of images. Each current generation of images generally includes a leader 
image and a plurality of child images. A copy of an original digital image is made the 
leader image of a first generation of images and the leader image is assigned a neutral 
leader genotype. A plurahty of child genotypes are applied to the leader image with 
the apphcation of each child genotype yielding a child image. After all the child 
images for the current generation have been created, the child images are sequentially 
coiiq)ared to the leader image and a fitness rating is assigned to each child image. An 
in:q)roved image may be chosen at any time firom any of the images in the current 
generation of images or the evolution can continue by making the current generation 
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of images a previous generation of images and evolving a next gmeration of images 
to become the current generation of inoiages. 

In accordance with other aspects of the present invention, the method of 
evohition creates a next generation of images by evohdng a phirahty of next 
generation child images from a next generation leader image. The next generation 
child images are created by applying a plurality of next generation child genotypes 
that are evolved from the leader and child genotypes of the previous generation of 
images. To create the next generation child gmotypes, the leader genotype from the 
previous generation of images is recombined with a corresponding child genotype 
from the previous generation of images. The next generation child genotype is then 
mutated. A child image from the previous generation that received the highest fitness 
rating is made the next generation leader image. Each of the next generation child 
genotypes is apphed to the next generation leader image to produce a next generation 
of child images. Since the next generation leader image and the next generation child 
images become the current generation of images for the selection process, the method 
of evolution in accordance with the present invention may continue through unlimited 
generations. 

In accordance with other aspects of the invention, a genotype includes a 
pliu^aUty of genes. Each gene includes one or more parameters. The genotypes, 
genes and parameters are evolved through methods for recombination and mutation. 
In many cases, the parameters are used to interpolate one or more gradation curves 
for altering the leader inoage, Le., each parameter vahie may have a different gradation 
curve that is interpolated between a boundary gradation curve and a neutral gradation 
ciuve (y = x). The boundary gradation curves (and thus the interpolated gradation 
curves) may be linear or non-linear and may be predefined or generated specifically 
for the digital image being processed. The gradation curve defines the replacement 
values for current values in the digital image vAi^tn the gene is appUed to the digital 
image. In other cases, the method of the gene directly changes the current values isx 
the digital image. 

In accordance with fiirther aspects of the invention, any genotype may be 
stored independent of a digital image file and later appUed to a digital image as a 
template genotype. The stored genotype con5)rises a relatively small data file that 
may be easily transmitted between computers across a communication network. 
Other tCTaplate genotypes may be evolved by third parties or shipped with a product 
incorporating the present invention. 
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In accordance with yet further aspects of the invention, a printer calibration 
genotype may be provided as a ten^late genotype or evolved according to a method 
and system of the present invention. The printer cahbration genotype adjusts the 
digital image for the particular printing characteristics of the printer being calibrated. 
5 Before the digital image is seat to the printer, the printer calibration genotype is 
applied to the digital image. 

Brief Description of the Dravyings 
The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same becomes better understood by 
10 reference to the following detailed description, when taken in conjunction with the 
accoit^anying drawings, wherein; 

FIGURE 1 is a block diagram of a general purpose con^uter system suitable 
for inq)lementhig the present invention; 

FIGURE 2A is a block diagram illustrating a common storage method for 
15 storing a digital image file; 

FIGURE 2B is an iUustration of a color space model used by an actual 
embodiment of the present invention; 

FIGURES 3A, 3B and 4 are pictorial representations of a user interface 
provided by an actual embodiment of the present invention; 
20 FIGURE 5 is a functional flow diagram of a main processing loop, in 

accordance with the present invention; 

FIGURE 6 is a functional flow diagram illustrating an evolution of a digital 
in^iage, in accordance with the present invention; 

FIGURE 7 is a fimctional flow diagram illustrating a process of creating a set 
25 of child images firom a leader image using a method of genetic evolution, in 
accordance with the invention; 

FIGURE 8 is a fimctional flow diagram illustrating a process for recombining 
genotypes, in accordance with the present invention; 

FIGURE 9 is a fimctional flow diagram illustrating a process of recombining a 
30 leader genotype with a fitness-rated child genotype, in accordance with the present 
invmtion; 

FIGURE lOA is a fimctional flow diagram illustrating the process of mutating 
a genotype, in accordance with the present invention; 

FIGURE 1 OB is a mutation rate table containing values for mutation rates 
35 used in the process illustrated in FIGURE lOA; 
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FIGURE 1 1 is a fimctioiial flow diagrams ilhxstrating the process of applying a 
genotype to a digital image, in accordance with the present invention; 

FIGURES 12A-12C are a fiinctional flow diagram illustrating the process for 
creating RGB gradation curves for gene 1 (global color shifl:) of the present invention; 
5 FIGURES 12D-12E are graphs of boimdary gradation curves used by the 

process illustrated in FIGURES 12A-12C, in accordance with the present invention; 

FIGURE 12F is an illustration of interpolating an interpolated gradation cxirve 
between a boundary gradation curve and a neutral gradation curve; 

FIGURE 13A is a fimctional flow diagram illustrating a process of providing 
10 the RGB gradation curves for gene 2 (color tenq)erature) in accordance with the 
present invention; 

FIGURES 13B-13D are graphs of boundary gradation curves used in the 
method illustrated in FIGURE 13 A; 

FIGURE 14 is a fimctional flow diagram illustrating a method for specifying 
15 the RGB gradation curves for gene 3 (effects), in accordance with the present 
invention; 

FIGURE ISA is a fimctional flow diagram illustrating the method for 
determining a blackpoint and whitepoint gradation curve for gene 8 
(blackpoint/whitepoint), in accordance with the present invention; 
20 FIGURE 1 SB is a graph of an exanq)le blackpoint and whitepoint gradation 

curve; 

FIGURE 16A is a fimctional flow diagram illustrating process of providing the 
RGB gradation curves for gene 4 (brightness), in accordance with the present 
invention; 

25 FIGURES 16B-16C are graphs of boundary gradation curves referenced by 

the processes of FIGURES 16A and 18; 

FIGURE 17 is a fimctional flow diagram illustrating the process of providing a 
contrast gradation curve for gene 5 (contrast), in accordance with the present 
invention; 

30 FIGURE 18 is a fimctional flow diagram illustrating the process of adjusting a 

pixel's color saturation value using gene 6 (color saturation), in accordance with the 
present invention; 

FIGURES 19A-19B are a fimctional flow diagram illustrating the method for 
adjusting the black level in primary colors using gene 7a (black level), in accordance 
35 with the present invention; 
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HGURES 19C-19D illustrate cuives referenced by the method of 
FIGURES 19A-19B; 

FIGURES 20A-20C are a functional flow diagram illustrating the method for 
selective color correction of a pixel usmg gene 7b (selective color correction), in 
5 accordance with the present invention; 

FIGURE 21A is a fimctional flow diagram illustrating a process for preparing 
a contrast gradation curve for gene 9 (contrast gradation curve), ia accordance with 
the present invention; 

FIGURES 2 IB and 21C are pictorial representations of a histogram and a 
10 gradation curve, respectively, calculated by the process illustrated in FIGURE 21 A, in 
accordaace with the present invention; 

FIGURE 22 is a fimctional flow diagram of a process for removing optical 
distortion ia digital images (dewaip), ia accordance with the present invention; and 

FIGURES 23A-23C are a fimctional flow diagram illustrating a process for 
15 cahbrating a printer using a genetic algorithm, in accordance with the present 
invention. 

Detailed Description of the Preferred Embodiment 
FIGURE 1 illustrates a computer system 100 of conventional design that is 
suitable for practicing the present invention. The computer system iachides a central 

20 processing unit (CPU) 110 that executes program instractions and manipulates digital 
data. The central processing unit 1 10 is coupled to a volatile memory 1 12 and a non- 
volatile memory 114 that store the program iastmctions and data. The central 
processing unit 110 is coupled to a video monitor 116, which provides a human 
recognizable mediimi for the display of digital images, text and other data to a user, 

25 A keyboard 1 19 and a pointer device 1 17 (a "mouse") are coupled to the CPU 1 10 for 
providmg mput to the con5)uter 100. A printer 118 may be coupled to the CPU 100 
to provide printouts of images, text and other data. The CPU 110 may also receive 
input from devices such as a digital camera 120 or optical scanner 122. Both the 
digital camera 120 and the optical scanner 122 record photographic images as 

30 con^uter-readable digital image files. 

A pluraHty of conq)uters 100 may be connected to a communication 
network 124 such as a local area network (LAN), a wide area network (WAN), or 
global network such as the Internet. For the ease of discussion below, it will be 
assumed that only a user coixqiuter 100 and a remote computer 126 are connected to 
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15 



20 



the commumcation network 124. A remote computer 126 is generally smnlar in 
configuration to that described for computer 100. 

A digital image file 210 (HGURE 2A), such as that created by the digital 
camera 120 or the optical scanner 122 (FIGURE 1), comprises data representing a 
phirahty of pixels 212. When rendered on the video monitor 116 or the printer 118, 
the phirahty of pbcels visually form an image. In FIGURE 2A, the digital image 
file 210 is assmned to be 480 x 480 pbcels in size. Of course, other digital image file 
sizes, formats and resolutions can be used when practicmg the present invention. 

An exemplary pixel 212 is shown m a partial view in FIGURE 2A. The 
pixel 212 is defined by a red (R) data value 214, a green (G) data vahie 216, and a 
blue (B) data vahie 218 (coUectively the "RGB values"). Together, a red (R) data 
value 214, a green (G) data vahie 216, and a blue (B) data vahie 218 define a color 
for the pixel 212 from a set of colors available m a color space. A color space is a- 
mathematical representation of a set of colors. In other words, by specifying an R 
vahie 214, a G vahie 216, and a B value 218, a color in the color space can be 
repUcated 'for each pixel 212 on the video monitor 116, a printer 118, or other device. 

A RGB color space is ilhistrated in FIGURE 2B as a hexagon 220, with each 
of the additive and subtractive primary colors indicated at a vertex. The primary 
colors red 222. green 224, and yellow 226 are known as the additive primary colors, 
and the primary colors magenta 228, cyan 230, and blue 232 are known as the 
subtractive primary colors. Using either of the additive primary colors 222, 224, 226 
or the subtractive primary colors 228, 230, 232, any color within the color space can 
be specified. The number of colors that can be specified in the color space depends 
on the resolution of each RGB vahie 214, 216, and 218. The resohition is defined by 
the number of bits of data that are used to capture and store each of the RGB 
vahies--the more bits, the more colors that can be described In the foUowing 
discussion, it will be assumed that the RGB vahies have a resolution of eight bits, 
or 256 possible vahies. Each pbcel, therefore, can specify more tiian 1.6mimon 
different colors in tiie RGB color space defined by hexagon 220. However, the 
30 resolution and size (number of pixels) m tiie digital image is not important to 
processes of the present invention. The digital image file 210 may have a resohition 
that is higher or lower depending on the quahty reqmrements for die digital image, 
and practical matters such as storage requirements for the digital image file 210. 
Other color space models may be used without departing from tiie scope of tiie 
35 present mvention. Exaxaples of otiier color space encoding include YIQ, YUV, 
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YCbCr, HSI, and HSV. All of these color spaces can be translated to the RGB color 
space 220 described herem using well-known conversion methods. 

The digital image file 210 may be stored in many different formats that are 
well known in the art. For instance, the RGB values 214, 216, 218 can be individually 
stored for each pixel in the digital image file 210 in a bitmap, or these RGB values 
may be translated, compressed and stored in a variety of other formats such as TIFF, 
JPEG, or MPEG, among other known digital image file 210 formats. All file formats 
may be processed by the present invention. 

A user interface 300 provided by an actual embodiment of the present 
invention is illustrated in FIGURES 3A-3B and 4. In FIGURE 3A, the user 
interface 300 includes a menu bar 310 that contains menus named File 312, Edit 314, 
View 316, Window 318, Special 320, and Help 322. The File menu 312 inchides a 
drop-down menu that includes items for saving and retrieving the digital image 
file 210 to and from the non-volatile memory 114, including options to Open, Open 
Special, Close, Save, Save As, and Save Genotype As. The Open Special option will 
be discussed fiirther with reference to FIGURE 3B. A genotype may be saved in a 
separate data file using the Save Genotype As option in this menu (genotypes are 
discussed below beginning with the discussion of image evolution in FIGURE 5). The 
digital image file 210 may also be loaded into the appfication controlling the user 
interface 300 using file menu options to Acquire the image firom a device such as 
scanner 122 (FIGURE 1) or from another device using a Select Source menu option. 
The image may be printed on the printer 118 using File menu options for Print, Print 
Preview (on the display), Printer Setup, and Printer Calibration. Printer caUbration is 
described below with reference to FIGURE 26A-C. The user may also select an 
option for Preferences or may select an Exit option from the drop-down menu to end 
the appUcation. 

The Edit menu 314 includes options to Undo the Last Action, Perfomi a 
Dewarp on the Inoage, to Start Evolution, and to Rotate Lefl;, Rotate Right, Resize 
Image, Crop Image, and to Remove Red Eyes. The Perform a Dewarp option is 
discussed below with reference to FIGURE 22 and the Start Evolution option is 
discussed below beginning with FIGURE 6. 

The View menu 316 allows for the selection of user interface elements that the 
user wishes to appear in user interface 300. These user interface elements include a 
Toolbar menu item (toolbar 324), a Status Bar menu item (status bar 326), a 
Navigator window menu item (navigator 328), and Genotypes wfaidow menu item 
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(genotypes 330). The View menu 316 also provides the options to Compare to 
Origmal and to present the Optimal View of the image. 

The Special menu 320 allows options to adjust the Color Tem5)erature of the 
image (FIGURE 13A) and the Genotype Intensity (FIGURE 6). As will be better 
5 understood from the followmg discussion, this is acconq)lished by the use of a slider 
that goes from 0 % to 100 %. All genes are interpolated between their current value 
(= 100 %) and their neutral value (= 0 %). The \^%dow and Help menus 318 and 
322 oflFer menu items weU known to those skilled in the art and will not be discussed 
fiuther. 

10 Referring to FIGURE 3 A, the user interface 300 has an image display 

area 332 that displays a digital image file 210 that has been opened for enhancemrat. 
In the remainder of this discussion, the digital image file 210, as it exists when loaded 
into the present invention, will be referred to as a parent image 334. A miniature 
(thumbnail) version of the parent image 334 is displayed in a navigator 328 window. 

15 By using a slider control 336, a minus command button 338 or a plus command 
button 340, a user can select a percentage of the total image and only a portion of the 
parent image 334 will be displayed in the display area 332. 

The genotypes list box 330 contains a list of template genotypes that may be 
applied to the parent image 334 to change the parent image 334 according to the 

20 predefined genes and gene parameters of the ten^)late genotype selected. For 
instance, if the inverse (INV) ten^late genotype 335 is selected from the list box and 
an Apply command button 340 is activated, the INV tero^plate genotype 335 would be 
appUed (FIGURE II) to the parent image 334 and would result in an evolved image 
replacing the parent image in the display area 332. In the exan:q)le shown, the evolved 

25 image would appear as a black background with a white outline of a sailboat. If a 
Reject control button 342 is activated, the parent image 334 will revert to the state it 
was in just before the INV ten^)late genotype 335 was applied. 

The toolbar 324 includes command buttons for many of the fimctions 
described as menu items in the menus 310 described above. In particular, a Dewarp 

30 command button 344 activates the image Dewarp process illustrated in FIGURE 22, a 
color ten:q)erature button 346 adjusts the color ten:q)erature as illustrated in 
FIGURE 1 3 A, an image cropping command button 348 activates a fimction for 
cropping the parent image 334, and a remove red eyes command button 350 activates 
a remove red eyes fimction. 
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The user interface presented when the Open Special method of the present 
invention available from the drop-down file menu is invoked as illustrated in 
FIGURE SB. The Open Special user interface 360 includes a directory tree 
window 362 for selecting the directory 364 containing image data files \diich may be 
5 imported into the present invention. Each image 366A, 366B, 366C, 366D, 366E . . . 
stored in the directory 364 is displayed as a thumbnail image that, when selected (as 
indicated by a dark border surroimding the image), is opened for editing by the 
present invention by activating an Open button 368. A drop-down list box 370 Usts 
available tenqilate genotypes. When an available tenq)late genotype is selected, 

10 selected thimibnail image (or images) are changed by the selected template genotype. 
When loaded, the loaded image is changed by the selected ten^late genotype. 

The present invention quickly and eflBciently improves the quaUty of digital 
images through evolution. The evolution process is initiated by activating the Start 
Evolution command button 352 (FIGURE 3A). Referring to FIGURE 4, when the 

15 Start Evolution conunand button 352 is actuated, the image display area 332 changes 
to display a copy of the parent image 334 as a leader image 334A in the left-hand 
portion 417 of the image display area 332 and one of a set of four child images 334B, 
334C, 334D, and 334E m the right-hand portion 415 of the image display area 332. 
Thumbnail images of the leader image 334A and of the foxir child images 334B-E are 

20 displayed in a legend area 410 together with an indication 412 of the generation to 
which the images 334A-E belong. Each child image 334B-E is sequentially displayed 
in the right-hand portion 415 of the image display area 332 for con^parison with the 
leader image 334A that is displayed in the left-hand portion 417 of the image display 
area 332. The child image 334B is conq)ared to the leader image 334A and fitness 

25 rated by selecting a portion of a graduated control 414. The graduated control 414 
has a "no better or worse" portion 416 and a graduated portion 418 associated with 
values fi-om 1% to 100% better. By using the pointer device 117 to select a portion 
of the graduated control 414, a fitness value equal to the percentage selected firom the 
graduated control 414 (and displayed 419 below the graduated control 414) is 

30 associated with the child image 334B. Once a fitness value has been associated with 
the child niiage334B, the next child image 334C is displayed in the right-hand 
portion 415 of the in[iage display area 332 for comparison with the leader 
image 334A, The process of assigning a fitness rating for images 334D and 334E 
continues in the same manner just described. The status bar 326 displays an indication 
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of the current generation and the number of the child image 334B-E that is currently 
being compared. 

At any point during the com5)arison process, the evolution can be stopped by 
activatiag a Stop Evolution command button 420. In response to activating the Stop 

5 Evolution command button 420, a user dialog is displayed asking whether the left 
image (leader image 334A) or the right image (child image 334B-E) shoxxld be kept. 
The kept image can then be saved as a new digital image file 210 or otherwise 
manipulated by the usei^s conq)uter 100, 

If the evolution of the image is allowed to continue, a next generation is 

10 evolved and a next generation leader image 422A is displayed in the right-hand 
portion 417 of the video display area 332. As is discussed below in more detail, the 
next generation leader image is created fi-om a (new) leader genotype that is produced 
by recombining the (previous) leader genotype with the genotype of the highest 
fitness-rated child from the last generation. Four next generation child images 422B- 

15 E are evolved and displayed in the legend area 410 with an indication 412 that the 
second generation is being viewed. The child images 422B-E are then compared to 
the leader image using the graduated control 414 to assign fitness ratings as is 
discussed above. 

It should be noted that what constitutes the "best" or "most fit" image 
20 (reflected by the value that is assigned to each image 334B-E, 422B-E, etc.) process 
is subjective and may differ among any two users because of the user's perception of 
color and personal preferences. The evolution process may be continued through any 
number of generations until the user finds the best image according to that user's 
subjective tastes. As will become apparent in the following discussion, the method of 
25 the present invention for very quickly evolving a "best" image (according to the 
individual tastes of the user) is based in part on the user's mdication of a fitness rating 
of each of the child images 334B-E, 422B-E, etc. 

The methods of the present invention for in^roving a parent image through 
evolution will now be discussed in detail beginning with FIGURE 5. A parent image 
30 is imported 510 fi-om the non-volatile memory 1 14 (or other so\u-ce such as the digital 
camera 120 or optical scanner 122) into a workspace available to the present 
invention in the volatile memory 112. When in^orted 510, the encoded information 
describing the parent image (e.g., in formats such as bitmap, JPEG, lltt, etc.) is 
translated into equivalent red, green, and blue (RGB) values for each pixel 212 in the 
35 digital image 210. As will be understood by those skilled in the art, the translation of 
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the information describing the parent image into the RGB color space 220 is not 
absolutely necessary and the method of the present invention coidd be applied equally 
to many other color space models that are well known within the art. 

Once the parent image is converted into pixels described by RGB values, the 
parmt image can be modified according to the present invention by image 
evolution 512, applying a template genotype 514, or conducting an image 
Dewaip 516. Any digital image 210 can be accurately printed following a printer 
calibration 518 according to the method of the present invention. These four 
processes 512, 514, 516, 518 will be discussed below. Any or all of the above 
methods 512, 514, 516, 518 may be conducted in any order on a parent image imtil 
the program is exited 520. 

If image evolution is selected 522, evolution is performed 512 beginning with 
the process illustrated in FIGURE 6. Referring to FIGURE 6, the evolution 
method 512 sets 610 a leader genotype to a neutral genotype. A genotype is a set of 
genes (described below) that are used to alter a digital image in a number of ways. A 
neutral genotype contains genes that do not affect the digital image to which they are 
applied. The evolution of the first generation of child images may be produced using 
predefined genotypes or evolved genotypes. If predefined genotypes are 
selected 612, then the method 512 selects a plurality of predefined tenqjlate genotypes 
that are used as the initial child genotypes. Each child genotype is applied 616 to the 
leader image to produce a corresponding child image. The child images are 
displayed 618 and the method 512 receives the fitness ratings of each of the child 
images from the user (as was described above with reference to FIGURE 4). 

If a request has not been received to end the evolution (e.g., by pressmg the 
Stop Evolution command button 420), the evolution continues 620 by 
recombining 622 the genotype of the child in:iage that received the highest fitness 
rating with the leader gmotype as a next generation leader genotype. As is illustrated 
beginning in FIGURE 7, a next generation of child genotypes is evolved 624 using 
this next generation leader genotype. Altematively, if the evolution is ended 620, the 
method 5 12 is done 626. 

Referring to FIGURE 7, the evolve next generation method 710 begins by 
recombining 712 the leader genotype with a child genotype from the previous 
generation into a next generation child genotype. Recombination is discussed below 
with reference to FIGURE 8. The next generation child genotype is then mutated 714 
in the manner illustrated in FIGURE 10 and described below. Having been 
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recombined and mutated, the next generation child genotype is applied 716 
(FIGURE 11) to the currently loaded image (the leader image) to produce a next 
generation child image. The next generation child genotype is then associated with 
the next generation chfld image. 

As discussed above, an actual embodiment of the present invention produces 
four child images in each generation for cori:q)ari5on with that generation's leader 
image. Of course, greater or fewer child images can be produced in each generation. 
For each child genotype from the previous generation, the evolve next generation 
method 710 repeats (starting with recombining 712 the child genotype with the leader 
genotype into a next generation child genotype). Once all child genotypes has been 
processed, a decision 720 directs the evolve next generation method 710 to 
retum 722 all the next generation child images, together with their associated next 
generation child genotypes, as child images for presentation as a (new) current 
generation in the selection process described above (FIGURE 4). The method 710 is 
then done 724. 

The method 810 for recombining the leader genotype with each child 
genotype to produce a plurality of next generation child genotypes is illustrated in 
FIGURES. The method 810 retrieves 812 a leader genotype. (It is to be understood 
that each of the methods described herein may retrieve, create or be passed data.) A 
child genotype is th^ retrieved 814. The individual genes of the leader genotype are 
recombined 816 with the genes of the child genotype into a next generation genotype, 
in the manner illustrated in FIGURE 9 and described below. If another child genotype 
is to be recombiaed, a decision 818 returns the method 810 to the retrieval 814 of 
another child genotype and the process is repeated. When all of the child genotypes 
have been recombined with the leader genotype, the next generation genotypes are 
returned 820 as the (new) child genotypes to block 712 in FIGURE 7. The 
method 810 is then done 822. 

Referring to FIGURE 9, the method 910 of the present invention for 
recombining the leader genotype with a child genotype begins by retrieving 912 a 
leader gene from a set of genes contained in leader genotype. A corresponding child 
gene is also retrieved 912 from the child genotype. Each gene may contain one or 
more parameters which are retrieved 914 one at a time from the leader gene and then 
the corresponding child gene. A next generation gene parameter is conq)uted 916 by 
taking a weighted average of the leader gene parameter and the child gene parameter. 
In this con5)utation 916, the child gene parameter is weighted by a factor that equals 
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the fitness rating that was assigned to the child genotype (as discussed above with 
reference to FIGURE 4). For instance, if the resohition was eight bits (256 vahies), 
the weighting formula would be: 

D NextGenerahonGeneParameter ~ 

127 

This weighted average fommla produces a next generation geae parameter 
that is stored 918 in a next generation gene. A decision 920 is made to determine if 
there is another gene parameter to process. If so, the method 910 returns to 
retrieve 914 the (next) leader gene parameter from the leader gene and a 

10 corresponding child gene parameter from the child gene. If all gene parameters have 
been processed, the decision 920 directs the method 910 to store 922 the next 
generation gene in the next generation genotype. If there is another leader gene to 
process, a decision 924 returns the process to the beghming of method 910 to 
retrieve 912 the next leader gene and a corresponding child gene. If the decision 924 

15 determines that there is not another leader gene to process, then the method 910 is 
done 926. 

The method 1010 for mutating a genotype is shown in FIGURE lOA. The 
method 1010 retrieves a genotype to be mutated from a block 714 in FIGURE 7. A 
gene from the genotype is retrieved 1012 and a mutation rate is obtained for the gene 

20 from a mutation rate table (FIGURE lOB). The mutation rate table provides the 
mutation rate to use for the gene being processed (column) and the number of the 
generation currently being processed (row). For instance, if gene 4 is being mutated 
from generation 5, cell 1016 would be selected to obtain a value of "18" hexadecimal. 
If the evolution has progressed through more than 16 generations, the mutation rate is 

25 selected from the generation 16 column according to the genes row. For instance, all 
mutations after the 16th generation for gene 5 will have a mutation rate found in 
ceU 1018 that indicates a hexadecimal value of "lA". 

Returning to FIGURE lOA, the mutation rate is multiphed 1022 by a 
Gauss-random value to produce a mutation value from a Gauss-random function. 

30 The Gauss-random fimction returns a value that makes small changes to the mutation 
rate very probable while big changes will seldom occur. Gauss-random fimctions are 
well known to those skilled in the art and will not be fiirther discussed. The mutation 
value is then added to the gene to produce a mutated gene. If the gene has multiple 
parameters, all parameters are mutated. The mutated gene is then stored 1026 m a 
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mutated genotype. If another gene in the genotype needs to be processed, the 
method 1010 is directed 1028 to retrieve 1012 the next gene in the genotype. If 
another gene is not present in the genotype to be mutated, the method 1010 is 
directed 1030 to return 1032 the mutated genotype as the next generation genotype. 
The method 1010 is then done 1034. 

The method 1110 for applying a genotype to a digital image is shown in 
FIGURE 11. The leader (currently loaded) image is retrieved 1112. The child 
genotype to be applied to the leader image is also retrieved 1114. A pixel is 
retrieved 1116 from the currently loaded image and a gene is retrieved 1118 from the 
genotype. The gene is apphed 1120 to the pixel according to a method associated 
with each gene, as is discussed below in detail with reference to FIGURES 12A-21. 

A decision 1 122 determines if there is another gene in the genotype that still 
needs to be processed. If so, the method 1110 directs 1 124 the retrieval 1118 of the 
next gene from the genotype. If there is not another gene in the genotype to be 
processed, the decision 1122 directs 1126 the method 1110 to store 1128 the newly 
altered pixel in a child image. A decision 1 130 determines if there is another pixel ia 
the currently loaded image that still needs to be processed, and directs 1132 the 
method 1 1 10 to repeat starting with retrieving 1 1 16 the next pixel from the cmrently 
loaded image. If there is not another pixel in the currently loaded image, the 
decision 1130 returns 1136 the child image and the associated genotype to the calling 
method. The method 1 1 10 is then done 1 138. 

As mentioned above, FIGURES 12A-21 detail a set of nine genes ia a 
genotype provided by an actual embodiment of the mvention. Other genes may be 
added to the genotype and still be within the scope and spirit of the present invention. 
For instance, a gene could be developed to create artistic effects for the image using 
the methods and systems described below. While the order that the genes are applied 
does not have to be strictly defiaed, the genes below are discussed in the order that 
they are apphed in an actual embodiment of the invention. 

Many of the genes described below include methods for defining a new 
gradation curve for each of the R, G, and B values. The apphcation of the gradation 
curves specified by these genes occurs in FIGURE 11. Using the value of the gene 
parameter, a gradation curve (e.g., FIGURE 12D) is generated. This generated 
gradation cxirve is then referenced to assign a new value (the y-coordinate) to the 
R 214, G 216, or B 218 value for each pixel in the digital image. 
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The gradation curves shown in the FIGURES are illustrated as continuous 
curves both to more clearly point out the concept of the present invention and to 
point out that the methods and systems of the present invention apply equally to 
digital images of all resolutions, e.g., a gradation curve may be applied to a digital 
image with 8-bit resohition equally as well as to a digital image with. 32-bit resolution 
simply by calculating a greater range of data points for (or from) the gradation curve. 
In an actual embodiment of the invention, interpolating a gradation curve 
(FIGURE 12F) is actually conqiuting a new value (y-co ordinate) for each possible old 
value (x-coordinate). Since this discussion assumes an 8-bit resolution, 256 new 
values (y-coordinates) are calculated— one for each of the possible old values 
(256 possible values). In some circumstances it may be more eJBBcient to calculate all 
of these new values at once and store the new values (y-coordinates) in a lookup table 
keyed by the old value (x-coordinate). In other circumstance it may be more efficient 
to calculate a single new value (y-coordinate) as needed. Unless described otherwise 
below, the new value (y-coordinate) is an interpolated value calculated between a 
predefined or dynamically calculated boundary curve and a neutral curve (y = x). 

It should be noted that the predefined boundary gradation curves described for 
the use of the genes discussed herein have been determined empirically and may be 
changed as fiuther experience dictates. The same is trae for the predefined data 
points used by some genes to dynamically calculate botmdary gradation curves. 

In FIGURE 12F, an example of interpolating a gradation curve is illustrated 
including: a neutral gradation curve (y = x) 1202, an example of a positive boundary 
gradation curve 1204, and an interpolated gradation curve 1206. The interpolated 
gradation curve 1206 in this Gxmnple represents a weight (or parameter) value of 89, 
If the gene is defined by an 8-bit signed integer, giving 127 possible positive values 
(and 127 possible positive interpolated gradation curves), the positive boundary 
gradation curve 1204 represents the maximum parameter vahie (127). A gradation 
curve for any positive parameter value may be interpolated in between the neutral 
gradation curve 1202 (y = x) and the positive boundary gradation cxu^e 1204 by using 
a weighted interpolation formula to con^)ute a new y-coordinate (ynew) for the 
interpolated gradation ciuve 1206 from the boxmdary gradation curve 
(yboundary) 1204 for each possible RGB value (x): 
For each x (256 values): 
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(yboundary — x) • parameter 



The interpolated gradation curve 1206 therefore comprises 256 new values 
(ynew) that may be stored in any convenient data structure for use in the methods and 

5 systems described herein, such as the lookup table described above or each ynew 
pobt may be calculated as needed. 

The global color shift of gene 1 is accomplished by calculating a gradation 
curve for each of the RGB values. Gene 1 has three parameters, with the first 
parameter specifying wiiich two of the three RGB gradation curves will be 

10 interpolated. If the gene 1 first parameter is 1, new red and green gradation curves 
are interpolated and the blue gradation curve is assigned a neutral gradation 
curve 1202. When the first parameter of gene 1 is equal to 2, new green and blue- 
gradation curves are created and the red gradation curve is assigned the neutral 
gradation curve 1202. If the first parameter of gene 1 is equal to 3, new red and blue- 

15 gradation curves are calculated and the green gradation curve is assigned the neutral 
gradation curve 1202. The second and third parameters of gene 1 are specified by a 
signed 8-bit integer with a range of -128 to +127. A gradation curve is calculated for 
every possible value of parameter 2 (and 3) by calculating a weighted interpolation 
between a predefined boimdary curve and the neutral curve. 

20 Referring to FIGURE 12A, a method 1210 of gene 1 is illustrated to produce 

red, green and blue gradation curves for use in the global adjustment of color in the 
image. Two of these gradation curves are interpolated using the second and third 
parameters of gene 1. The remaining color is assigned the neutral gradation curve 
(y = x). If gene 1 of a leader genotype has a first parameter equal to one, a 

25 decision 1212 directs 1214 the process to a decision 1216 that checks if the second 
parameter is positive. If the second parameter is positive, the decision 1216 
directs 1218 a method 1220 to use the second parameter of the leader g^otype 
gene 1 as a weight value to interpolate a new red global color shift gradation curve 
between a positive global color shift boundary gradation curve (FIGURE 12D) and 

30 the neutral gradation curve 1202 (FIGURE 12F). Returning to decision 1216, if the 
leader genotype gene 1 has a second parameter that is negative, the method 1210 
continues 1222 by using the leader genotype gene 1 second parameter as the weight 
value to interpolate a new red global color shift gradation curve 1224 between the 
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negative global color shift gradation curve (FIGURE 12E) and the neutral gradation 
curve 1202 (FIGURE 12F). 

Following the inteq)olation of the new red global color shift gradation 
curve 1220 or 1224, a decision 1226 is made whether the third parameter of the 

5 leader gmotype gene 1 is positive. If so, the third parameter of the leader genotype 
gene 1 is used as the weight value to inteipolate a new green color shift gradation 
curve between the positive global color shift gradation curve (FIGURE 12D) and the 
neutral gradation curve 1202 (FIGURE 12F). If m the decision 1226 it is determined 
that the third parameter is not positive, the third parameter of the leader genotype 

10 gene 1 is used as the weight value to interpolate 1232 a new green global color shift 
gradation curve between the negative global color shift gradation curve 
(FIGURE 12E) and the neutral gradation curve (FIGURE 12F). A new bhie 
gradation curve is assigned 1233 the neutral gradation curve (FIGURE 12F). 

After the RGB gradation curves have been interpolated or assigned 1230, 

15 1232 or 1233, or if the first parameter of the leader genotype gene 1 is not equal to 
one (decision 1212), the method 1210 continues as illustrated ia FIGURE 12B. If 
gene 1 of a leader genotype has a first parameter equal to two, a decision 1234 
directs 1236 the process to a decision 1238 that checks if the second parameter is 
positive. If the second parameter is positive, the decision 1238 directs 1240 the 

20 method 1210 to use the second parameter of the leader genotype gene 1 as a weight 
value to hiterpolate 1242 a new green global color shift gradation curve between the 
positive global color shift boundary gradation curve (FIGURE 12D) and the neutral 
gradation curve 1202 (FIGURE 12F). Retummg to decision 1238, if the leader 
genotype gene 1 has a second parameter that is negative, the method 1210 

25 continues 1244 by using the leader genotype gene 1 second parameter as the weight 
value to hiterpolate a new green global color shift gradation curve 1246 between the 
negative global color shift gradation curve (FIGURE 12E) and the neutral gradation 
curve (FIGURE 12F). 

FoUowittg the interpolation of the new green global color shift gradation 

30 curve 1242 or 1246, a decision 1248 is made whether the third parameter of the 
leader genotype gene 1 is positive. If so, the third parameter of the leader genotype 
gene 1 is used as the weight value to interpolate a new blue color shift gradation 
curve 1252 between the positive global color shift gradation curve (FIGURE 12D) 
and the neutral gradation curve (FIGURE 12F). If in the decision 1248 it is 

35 determined that the third parameter is not positive, the third parameter of the leader 
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genotype gene 1 is used as the weight vahie to mterpolate a new bhxe global color 
shift gradation curve 1256 between the negative global color shift gradation curve 
(FIGURE 12E) and the neutral gradation curve 1202 (FIGURE 12F). A new red 
gradation curve is assigned 1257 the neutral gradation curve 1202 (FIGURE 12F). 

After the RGB gradation curves have been interpolated or assigned 1252, 
1256 or 1257, or if the first parameter of the leader genotype gene 1 is not equal to 
two (decision 1234), the method 1210 continues as illustrated in FIGURE 12C. If 
gene 1 of a leader gmotype has a first parameter equal to three, a decision 1260 
directs 1262 the process to a decision 1264 that checks if the second parameter is 
positive. If the second parameter is positive, the decision 1264 directs 1265 the 
method 1210 to use the second parameter of the leader genotype gene 1 as a weight 
value to interpolate 1266 a new red global color shift gradation curve between the 
positive global color shift boundary gradation curve (FIGURE 12D) and the neutral 
gradation curve (FIGURE 12F). Returning to decision 1264, if the leader genotype 
gene 1 has a second parameter that is negative, the method 1210 continues by using 
the leader genotype gene 1 second parameter as the weight value to interpolate a new 
red global color shift gradation curve 1268 between the negative global color shift 
gradation curve (FIGURE 12E) and the neutral gradation curve (FIGURE 12F). 

Following the interpolation of the new red global color shift gradation 
ciuve 1266 or 1268, a decision 1270 is made whether the third parameter of the 
leader genotype gene 1 is positive. If so, the third parameter of the leader genotype 
gene 1 is used as the weight value to interpolate a new blue color shift gradation 
curve 1274 between the positive global color shift gradation curve (FIGURE 12D) 
and the neutral gradation curve (FIGURE 12F). If in the decision 1270 it is 
determined that the third parameter is not positive, the third parameter of the leader 
genotype gene 1 is used as the weight value to interpolate a new blue global color 
shift gradation curve 1278 between the negative global color shift gradation curve 
(FIGURE 12E) and the neutral gradation curve (FIGURE 12F). A new green 
gradation curve is assigned 1279 the neutral gradation curve (FIGURE 12F). 

Gene 2 adjusts the color ten^erature of the child image 334B-E. Color 
tenq)erature may be thought of as simulating a "warmer" or "colder" ambient light in 
the digital image. Gene 2 has a single parameter defined by a signed 8-bit integer 
(values firom -128 to +127). Altered by gene 2, a negative parameter value result m 
the image looking warmer (lower color temperature caused by a shift toward orange- 
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red in the image) and a positive parameter will make the image look colder (higher 
color terr^erature caused by a shift toward blue in the image). 

The method for calculating the RGB gradation curves 1310 to adjust the color 
temperature of an image is shown in FIGURE 13 A. In an actual embodiment of the 
invention, a single new value (y-coordinates) is calculated for each of the RGB 
gradation curves, as needed, to adjust a single pixel instead of calculating and storing 
all of the new values (y-coordinates) of an interpolated gradation curve. However, 
the following will continue to refer to these new values as being part of a gradation 
curve to better illustrate the concept behind the method 13 10 of gene 2. 

The parameter value of gene 2 is used as a weight value to interpolate 1312 a 
red color temperature gradation curve ("RTemp") 1312 between a low temperature 
red boundary gradation curve (FIGURE 13B) and the neutral gradation curve 
(FIGURE 12F). Next, a green color ten[5)erature gradation curve ("GTen^)") is 
interpolated 1314 using the gene 2 parameter as the weight value in a weighted 
interpolation between a low ten^erature green boundary gradation curve 
(FIGURE 13C) and the neutral gradation curve (FIGURE 12F), Finally, a blue color 
temperature gradation curve ("BTen^)") is interpolated 1316 by using the gene 2 
parameter as the weight value in a weighted interpolation between a low tenq)erature 
blue boundary gradation curve (FIGURE 13D) and the neutral gradation curve 
(FIGURE 12F). 

A decision 1318 determines if the gene 2 parameter is positive and directs the 
method 1310 to find 1320 a new low temperature RGB value (y-coordinate) 
corresponding to the old RGB value (x-coordinate) firom each of the RGB low 
ten^erature gradation curves 1312, 1314, 1316, i.e,: 

R = RTen^)[x] 

G = GTemp[x] 

B = BTen5)[x] 

If the decision 1318 determines that the gene 2 parameter is not positive, the 
new RGB values are obtained 1322 firom a set of high teicqperature RGB gradation 
curves that mirror the low temperature RGB gradation curves about the neutral 
gradation cmve. The high ten^erature RGB gradation curves may be e>q)ressed 
mathematically as: 

R = x - (RTeniqpM - x) 
G = X - (GTemp[x] - x) 
B = X - (BTemp[x] - x) 



wo 00/33207 



-21- 



PCT/US99/28676 



Alternatively, the high-temperature RGB boundary gradation curves may be defined 
s^arately firom the lov^-tenqjerature boxmdary gradation ciuves and the high- 
tenqjerature RGB gradation curves interpolated between those separately defined 
high-ten[^)erature RGB gradation curves and the neutral gradation curve (FIGURE 
12F). The new RGB values obtamed in blocks 1320 or 1322 are then returned 1324 
as a new pixel for the child image. 

Gene 3 provides RGB gradation curves that define special effects. A 
method 1410 of gene 2 is illustrated in FIGURE 14. Gene 3 has three parameters that 
specify a gradation curve for each red, green, and blue value. The first parameter 
specifies 1412 a predefined gradation curve defimng an effect to the red component of 
each pixel. For example, a predefined effect gradation curve could provide an inverse 
for the red value by having the equation y = 255 - x. The second parameter of gene 3 
specifies 1414 a predefined effect gradation curve that defines an effect to the green 
conq)onent of the pixel. A third parameter specifies 1416 a predefined effect 
gradation curve that defines an effect to the blue value of each pixel. Depending on 
the effect desired, the first, second and third parameters may each specify the same 
gradation curve or a different gradation curve for each of the red, green and blue 
values. The method 1410 is then done 1418. 

Gene 8 determines a blackpoint and whitepoint gradation curve that is appUed 
to each of the RGB values. The method 1510 of gene 8 is shown in FIGURE 15 A, 
where the brightest color tone in the image is assigned 1512 as the whitepoint and 
then the darkest color tone in the image is assigned 15 14 as the blackpoint. Using the 
coordinates (0, whitepoint and 255, blackpoint) a linear gradation curve is 
computed 1516 between these coordinates. The method 1510 of gene 8 is then 
done 1518. An example of the gradation curve produced by gene 8 is shown in 
FIGURE 15B with the linear gradation curve 1520 extendmg between the 
blackpoint 1522 and the whitepoint 1524. 

The RGB gradation curves calculated by gene 4 affect the brightness of the 
image. Gene 4 has one parameter that is a signed 8-bit integer, ranging fi-om -128 
(maximum brightness) to +127 (minimum brightness). In an actual embodiment of the 
invCT^tion, the same calculated brightness gradation curve is used for all the RGB 
values. The method 1610 for calculating the brightness gradation curve of gene 4 is 
shown m FIGURE 16A and begins with a decision 1612 that detemunes v^ether the 
value of the gene 4 parameter is positive. If yes, a brightness gradation curve is 
interpolated 1614 by usmg the value of a gene 4 parameter as the weight value m a 
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weighted interpolation between a positive brightness/color saturation boundary cxirve 
(FIGURE 16B) and the neutral gradation curve (FIGURE 12F). If the decision 1612 
determines that the vahie of the gene 4 parameter is not positive, the weighted 
interpolation is made usmg the gene 4 parameter as the weight value between a 
negative brightness/color saturation boundary gradation curve (FIGURE 16C) and the 
neutral gradation curve (FIGURE 12F). After calculating the brightness gradation 
curve 1614 or 1616, the method 1610 is done 1618. 

The contrast gradation curve produced by gene 5 is applied equally to each of 
the RGB values to alter contrast as the red, green and blue gradation curve for 
contrast. Gene 5 has one parameter that is a signed 8-bit integer ranging from -128 
(lowest contrast) to +127 (maximimi contrast). The method 1710 for finding the 
contrast gradation curve of gene 5 begins by retrieviug 1712 the contrast parameter of 
gene 5. The contrast parameter is used as the weight value to interpolate 1714 a new 
contrast gradation curve between a boundary gradation curve generated by gene 9 
(discussed below with reference to FIGURE 21) and a neutral gradation curve 
(FIGURE 12F). Next, a new contrast vahxe is determined directly from the new 
contrast gradation curve 1716 for each of the RGB values of the pixel The 
method 1710 is then done 1718. 

The method 1810 for adjusting the color saturation of the image using gene 6 
is illustrated in FIGURE 18. Gene 6 has a single parameter that coirq)rises a signed 8- 
bit integer in an actual embodiment of the invention. The RGB values of the pixel 
being passed to method 1810 are each translated 1814 from their additive primary 
color values to the equivalent subtractive primary colors using the formulas: 

C (cyan) = 255 -R (red) 

M (magenta) =255 - G (green) 

Y (yellow) = 255 - B (bhie)] 

The black level (K) is assigned 1816 the minimum value of the C, M or Y: 

K = min(C,M,Y) 

This black level (K) is then temporarily removed 1818 from the subtractive 
primary colors using the formulas: 
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c (cyan) = C-K 

m (magenta) = M-K 

y(yeUow)-Y-K 

The subtractive primaiy colors are adjusted 1820 (FIGURE 11) using the 
Positive Boxmdary Brightness/Color Saturation Gradation Curves illustrated in 
FIGURES 16B and 16C (discussed above), weighted by the parameter of this gene. 
The black level (K) is then added back 1822 into the subtractive primary colors: 

C = c+K 
M = m+K 
Y = y+K 

The subtractive primary color values are translated back 1824 to their 
equivalent additive primary colors using the formulas: 

R = 255-C 
G = 255-M 
B = 255- Y 

The method 1810 then returns 1826 the new pixel for storage in the adjusted 
image and is done 1830. 

The method 1910 of gene 7A for adjustmg the black level in the primary 
colors of the image is illustrated in FIGURES 19A and 19B be ginnin g with the 
method 1910 retrieving 1912 the RGB values of a pixel. The RGB values are 
translated 1914 from the additive primary color values to the equivalent subtractive 
primary colors using the formulas: 

C (cyan) = 255 -R (red) 

M (magenta) = 255 - G (green) 

Y (yeUow) = 255 - B (blue) 

The black level is determined 1916 to be the minimum value of the three 
subtractive primary values C, M & Y, v^ch is otherwise e>q)ressed as: 
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K - mm(C,M,Y) 



The black level is teiq)orarily removed 1918 from the C, M & K values usmg 
the formulas: 

5 

c (cyan) = C-K 

m (magenta) = M-K 

y(yeUow) = Y-K 



10 and an intermediate color separation is made 1920 for each of the primary colors: 



b* (bhie) =min(c,m) 
r* (red) =naan(m,y) 
g' (green) =min(c,y) 
15 c' (cyan) =c-(g'+V) 

m* (magenta) =m-(r*+b*) 
y(yenow)=y.(r'+g') 



Using the intermediate color separation values (b*, r\ g*, c', m', y) as the 
20 x-coordinate, a Color Separation Graduation Curve (FIGURE 19C; "Curvel") is 
appUed 1922 to each of the intermediate color separation values: 



b7(blue) -Curveljb*] 
r7(red) =CurvelM 
25 g7(green) =Curvel[g'] 

c7(cyan) =Curvel[c'] 
m7(magenta) =Curvel[m'] 
y7(yeIlow) = Curve l[y] 



30 Each intermediate separation value is adjusted 1924 by applying a 

corresponding gene parameter from gene 7A. Unlike other genes that are directly 
evolved during the evolution process described above, the parameters of gene 7 A are 
changed by a regulator gene (gr) that is evolved during the evolution process. The 
regulator gene (gr) is set by the evolution process, i.e., by mutation and 

35 recombination. In an actual embodiment of the invention, the six gene parameters of 
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gene7A have the values that are calculated usmg a predefined weighting factor to 
adjust the value of the regulator gene, i.e. : 

gl = 0.7 * gr 
g2 = 0.15 *gr 
g3 = 0.11 *gr 
g4 = 0.078 * gr 
g5 = 0.94 * gr 
g6 = 0.94 * gr 



10 



The weight values used in gl-g6 have been determmed en^iricaUy and may be 
changed as experience dictates. In choosing the weight values, however, it should be 
considered that the reduction in the black vahie of color should not be equal for aU 
colors or unpleasant artifacts may result. It has been found that green, blue and cyan 
15 are the most robust against these artifects and may be weighted more heavily, whde 
red and yeUow are the least robust against manipulation and should have smaller 
weight vahies. Using the gene parameters of gene 7A, the mteimediate color 
separation values are adjusted 1924 uang the following formulas: 

20 b7 (blue) = (b7* gl)/127 

r7 (red) = (r7* g2)/127 

g7 (green) = (g7* g3)/127 

c7 (cyan) = (c7* g4)/127 

m7 (magenta) = (m7* g5)/127 
25 y7 (yellow) = (y7* g6)/127 

The method 1910 next determmes 1926 a black level correction factor (kf) 
from a predefined curve shoAvn m FIGURE 19D (the "kfCurve"). 

30 kf = kflCurve [K] 

and a black level correction vahie is calculated 1928 for each primary color using the 
formulas: 



35 



c"= kPc7/256 
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m"= kf*m7/256 
y"= kf*y7/256 
r"= k£*r7/256 
g"= kf*g7/256 

5 b"= kf*b7/256 

Each of the mtennediate color separation values is then enhanced 1930 with 
the black level correction values using the formulas: 

10 c'=c'+c" 

m'=m'+m" 

r'=r'+r" 
g-g'+g" 

15 b'=b'+b" 

Black is enhanced 1932 in accordance with the formula: 

K = K -c" - m" - y" - r" -g" - b" 

20 

Finally, the black enhanced RGB values for a new pixel are calculated 1934 
using the formulas: 

C = c'+b'+g' + K 

25 M = m'+r'+b' +K 

Y = y+r'+g" + K 



R=255-C 
G=255-M 

30 B = 255-Y 



and the new black enhanced RGB values are returned 1936 as an altered pixel for the 
child image. The method 1910 is then done 1938. 

The method 2010 for the selective color correction of the image by gene 7B is 
35 illustrated in FIGURES 20A-C. The pixel passed to the method 2010 is separated 
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2012 into the pixel's RGB values, which are translated 2014 to the equivalent 
subtractive primary colors, using the formulas: 

C (cyan) = 255 -R (red) 
5 M (magenta) = 255 - G (green) 

Y (yeUow) = 255 - B (bhie)] 

and the black level (K) is determined 2016 from the TniTiimnm of the C M & Y values. 
This black level is temporarily removed 2018 from the subtractive primary colors 
10 using the formulas: 

c (cyan) = C-K 

m (magenta) = M-K 

y (yellow) = Y-K 

15 

and an intermediate color separation is foimd 2020 as follows: 

b' (blue) =min(c,m) 
r* (red) =min(m,y) 
20 g' (green) =min(c,y) 

c* (cyan) =c-(g'4-b') 
m* (magenta) =m-(r*+b') 
y (yellow) =y-(r*+g') 

25 The method 2010 then retrieves the eighteen parameters of gene 7B which are 

stored as unsigned 8-bit integers for each color except black: an anq>lification factor 
for the color being processed, an anq)lification factor for the clockwise adjacent color 
on the color hexagon 220 (FIGURE 2B) to the color being processed, and an 
amplification factor for the counterclockwise adjacent color on the color hexagon 220 

30 (FIGURE 2B) to the color being processed. 

Using a spline algorithm, eighteen gradation curves (3 for each color except 
black) are conq)uted 2024 using the points: (0,0), (xpoint, ypoint), (255,255), where 
ypoint is equal to xpoint if xpoint is less than 230 or ypoint is equal to 230 if xpoint is 
greater than 230. Using 230 as the breakpoint has been determined empirically and 

35 may change as fiirther experience dictates. The resulting 18 gradation curves are: 
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BBCorrG BlueCorrection for Blue 

BCCorrQ CyanCorrection for Blue 

BMCorrQ MagentaCorrection for Blue 

MMCorrQ Magenta Correction for Magenta 

MBCorrQ BlueCorrection for Magenta 

MRCorrQ RedCorrection for Magenta 



10 



RRCorrQ RedCorrection for Red 
RMCorrQ MagentaCorrection for Red 
RYCorrD YellowCorrection for Red 



15 



YYCorrQ YellowCorrection for Yellow 
YRCorrQ RedCorrection for Yellow 
YGCorrQ GreenCorrection for Yellow 



20 



GGCorrO GreenCorrection for Green 
GY Corrn YellowCorrection for Green 
GCCorrQ CyanCorrection for Green 



25 



CCCorrQ CyanCorrection for Cyan 
CGCorrO GreenCorrection for Cyan 
CBCorrO BlueCorrection for Cyan 

Using a the corresponding gradation curve listed above, the primary colors are 
selectively corrected 2028, as follows: 



30 



b'- BBCorr[b'] 

c'=BCCorr[bl 

m'=BMCorr[b'] 



35 



= MMCorr[m'] 
V = MBCorr[m'] 
= MRCorr[mT 
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r* = RRCorrM 
m* = RMCorr[i'] 
y = RYCorr[i'] 

5 

y =YYCon-[y'] 
r'=YRCoiT[y] 
g'=YGCorr[y] 

10 g' = GGCoiT[g'] 

y = GYCoiT[g'] 
c' = GCCorr[g'] 

c' = CCCorr[c'] 

15 g' = CGCorr[c'] 

b' = CBCorr[c'] 

and then these selectively corrected colors are converted 2030 to their new RGB 
values and returned to the calling function as a new pixel for a child image using these 
20 formulas: 

R=r'+m'+y+K 
G=g'+c'+y+K 
B=b'+c'+m'+K 

The method 2110 of gene 9 provides the contrast gradation boundary curve 
25 that is used by the method 1710 of gene 5 (FIGURE 17). Referring to FIGURE 21A, 
the contrast gradation boundary curve is calculated by first converting 21 12 each pixel 
into gray according to a gray scale. A histogram is then created 21 14 that records the 
gray tone value of every pixel in the image with the x-axis of the histogram 
repres^ting the gray scale value and the y-axis of the histogram representing the 
30 fi^equency that that gray tone appears in the image. An exaiiq>le of such a 
histogram 2130 is illustrated in FIGURE 21B. The histogram is integrated fi-om its 
minimum value until 2% of the data members m the histogram has been reached. The 
value of the x-axis at this point is recorded 21 16, as a first parameter (A) of gene 9. 
Similarly, the histogram is integrated firom its maximum value toward its fninirniim 
35 vahie until 2% of the total data members has been reached. The value of the x-axis at 
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this point is recorded 2118 as a second parameter (B) of gene 9. The integration 
percentage (2%) was determined empirically and may be changed as experience 
dictates. 

Using a spline inteipolation, a S-shaped contrast gradation curve 2132 is 
5 calculated 2120 using (0,0) and (255,255) as the end points 2134, 2140 and the pomts 
(A, 12) and (B, 242) as the niflection pomts 2136, 2138. An example of this 
S-shaped contrast gradation curve with the end points and inflection points 2136, 
2138 just described is illustrated in FIGURE 21C. Since, sphne interpolation 
algorithms are well known in the art, they will not be discussed fiirther here. 

10 Returning to FIGURE 5, it is also possible to apply 514 a template genotype 

to the image without going through the evolution process. The terq)late genotype 
may be predefined and shipped as part of the product incorporating the invention or 
may be a genotype that has been saved firom a previous evolution. For example, a 
user may prefer a genotype that the user has evolved for photographs of mountains 

15 that the user wishes to apply to all pictures of mountains that the user works on. By 
saving the favored genotype as a ten^late genotype, the genotype may be 
selected 524 and the genotype apphed 5 14 to the image as was discussed above with 
reference to FIGURE 11, As mentioned above, any saved or tenq}late genotype 
forms a relatively small data ffle. This data file may be exchanged between 

20 appUcations en:5)loying the present invention, for instance, by sending the genotype 
data file firom the user's con^uter 100 over the communication network 124 to 
another user's remote con^uter 126 (FIGURE 1). 

The present invention also provides the option 526 to Dewarp the image. 
Performing 516 a Dewarp is illustrated in FIGURE 22. When taking a photograph 

25 through a lens, the not perfect shape of the lens may introduce a perceptible 
aberration m the image. The process of "Dewarping" an image minimizes the eflfect of 
this spherical aberration by redistributing the pixels in the image. The method 2210 of 
Dewaiping the image begms by retrieving 2212 a predefined set of correction 
coeflBcients A, B, C. A focal point is then determined 2214 in the parent image. For 

30 each pixel in the parent image, the pixel is retrieved 2216 and a vectored radius 
between the location of the pixel and the focal point is determined 2218. A new 
vectored radius for the pixel is determmed 2220 using the formula 
mew=ar+b*r^3+c*r^5. The pixel is then stored 2222 in a child image at the new 
vectored radius (mew). To make the image look more smooth, a bi-cubic 

35 interpolation is used. If there is another pixel to process in the parent image, a 
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10 



. ■ ■ n 7224 returns control to the retrieval 2216 of the next pixel and the method 
~frd^:a\hove. .there is not anoth. pixel to process.^ 

The last option su «^rdina to the method shown m 
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green-dominant te]iq)late genotypes are applied 2336 to the gray scale adjusted test 
image to create a set of green- dominant test images. A decision 2338 returns control 
to the block 2336 xmtil all green-dominant test images have been produced. 

The process is next repeated for a blue-dominant test image that is 
retrieved 2340 and adjusted by applying 2342 the printer gray scale genotype to the 
blue-dominant test image to create a gray scale adjusted test image. A set of blue- 
dominant genotypes are applied 2344 to create a set of blue-dominant test images 
using the control loop provided by decision 2346. When all the blue-dominant test 
images have been produced, the decision 2346 directs control to the display 2348 of 
each of the red-dominant, green-dominant, and blue-domdnant test images on the 
video monitor 116. Each of the red-dominant, green-dominant and blue-dominant 
test images are printed 2350 on a test page by the printer 118. The test images should 
be arranged as they are displayed on the display so that the user can intuitively select 
the images from the printed page on the video display. 

The user chooses 2352 a "best" red-dominant test image that appears on the 
printed test page and selects the corresponding red-dominant test imiage on the video 
monitor 116. This selects the genotype of the selected test image as the printer red- 
dominant genotype. Next, the user chooses 2354 the "best" green-dominant test 
image that appears on the printed test page and selects the corresponding green- 
dominant test image on the display. This assigns the genotype of the selected test 
image as the printer green-dominant genotype. The user then chooses 2356 the "best" 
blue-dominant test image that appears on the printed test page and selects the 
corresponding blue-dominant test image on the display. The genotype of the selected 
test image is assigned as the printer blue-dominant genotype. 

Using the method illustrated in FIGURE 8, the printer gray scale genotype, 
the printer red-dominant genotype, the printer green-dominant genotype, and the 
printer blue-dominant genotype are recombined 2358 to form a printer calibration 
genotype that is stored as a printer calibration tenq)late genotype and associated with 
the printer 118 being calibrated. When the printer 118 is next used by the present 
invention, the image to be printed can be modified using the printer calibration 
genotype as it is sent to the printer to be printed so that the in[iage printed matches the 
image displayed as closely as possible. The printer calibration method is then 
done 2360. 
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While the preferred embodiment of the mvention has been illustrated and 
described, it will be appreciated that various changes can be made therein without 
departing from the spirit and scope of the invention. 
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The embodiments of the invention in which an exclusive property or privilege 
is claimed are defined as follows: 

1. A computer-in5)lemented method of improving a digital image, the 
method conq)rising: 

(a) displaying a digital image and designating the digital image a 

leader image; 

(b) applying a child genotype to the leader image to produce a 

child image; 

(c) displaying the leader image and the child image so that a user 
can select which of the child image and the leader image is more desirable; and 

(d) repeating (b) and (c) for a plurality of child genotypes. 

2. The con:5)uter-inq)lemented method of Claim 1, wherein the child 
genotypes appUed to the leader image are next generation child genotypes and the 
child images are next generation child images. 

3. The conc5>uter-in5)lemented method of Claim 2, wherein the next 
generation child genotypes are evolved prior to being applied to the leader image to 
produce next generation child images. 

4. The computer-implemented method of Claim 3, wherein the leader 
image has an associated leader genotype and wherein evolving the next generation 
child genotypes conq)rises recombioing the leader genotype with a child genotype. 

5. The computer-in^lemented method of Claim 4, wherein evolving the 
next generation child genotypes also comprises mutating the recombined leader and 
child genotypes prior to the evolved next generation child genotypes being appUed to 
the leader image to produce a next generation child image. 

6. The con5)uter-implemented method of Claim 5, wherein mutating the 
recombined leader and child genotypes comprises: 

(a) selecting a gene firom the genotype; 

(b) determining a mutation rate for the gene; 

(c) using a random value to adjust the mutation rate; 
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(d) applying the value of the adjusted mutation rate to the gene to 
produce a mutated gene; 

(e) storing the mutated gene in a mutated genotype; and 

(f) repeating (a) through (e) for all genes in the genotype. 

7. The conr5)uter-in5)lemented method of Claim 4, herein recombining 
the leader genotype with a child genotype to evoke a next generation genotype 
comprises: 

(a) retrieving a leader gene from the leader genotype and a 
corresponding child gene from the child genotype; 

(b) retrieving a leader gene parameter from the leader gene and a 
corresponding leader gene parameter from the child gene; 

(c) producing a next generation gene parameter by confuting a 
weighted average of the leader gene parameter and the child gene parameter; 

(d) storing the next generation gene parameter in a next generation 

gene; 

(e) repeating (b), (c), and (d) for all parameters included in the 
retrieved leader gene; 

(f) storing the resulting next generation gene in the next 
generation child genotype; and 

(g) repeating (a) through (f) for all genes m the leader genotype. 

8. The computer-implemented method of Claim 7, wherein evolving the 
next generation child genotypes also con4)rises mutating the recombined leader and 
child genotypes prior to the evolved next generation child genotypes being appHed to 
the leader image to produce a next generation child image. 

9. The computer-implemented method of Claim 8, wherein mutating the 
recombined leader and child genotypes conq)rises: 

(a) selecting a gene from the genotype; 

(b) determining a mutation rate for the gene; 

(c) using a random value to adjust the mutation rate; 

(d) applying the value of the adjusted mutation rate to the gene to 
produce a mutated gene; 

(e) storing the mutated gene in a mutated genotype; and 

(f) repeating (a) through (e) for all genes in the genotype. 
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10. The coirputer-iirplemented method claimed in Claim 1, including 
storing a fitness value assigned to a child image by a user for each child image 
displayed with a leader image for a user to select which of the child image and the 
leader image is more desirable. 

11. The computer-iiDplemented method of Claim 10 \^4lerein the child 
genotypes appUed to the leader image are next generation child genotypes and the 
child images are next generation child images. 

12. The con[q)uter-inq)lemented method of Claim 11, wherein the next 
generation child genotypes are evolved prior to being applied to the leader image to 
produce next generation child images. 

13. The con4)uter-implemented method of Claim 12, wherein the leader 
image has an associated leader graotype and wiierein evolving the next generation 
child genotypes conq)iises recombining the leader genotype with a child genotype. 

14. The conq)uter-in^lemented method of Claim 13, wherein evolving the 
next generation child genotypes also conq)rises mutating the recombined leader and 
child genotypes prior to the evolved next generation child genotypes being applied to 
the leader image to produce a next generation child image. 

15. The computer-implemented method of Claim 14, wherein mutating the 
recombined leader and child genotypes comprises: 

(a) selecting a gene from the genotype; 

(b) determining a mutation rate for the gene; 

(c) ushxg a random value to adjust the mutation rate; 

(d) applying the value of the adjusted mutation rate to the gene to 
produce a mutated gene; 

(e) storing the mutated gene ia a mutated genotype; and 

(f) repeating (a) through (e) for all genes in the genotype. 

16. The coti:q)Uter-iiiq)lemented method of Claim 13, wherein recombining 
the leader genotype with a child genotype to evolve a next generation genotype 
coniprises: 

(a) retrieving a leader gene firom the leader genotype and a 
corresponding child gene fi*om the child genotype; 
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(b) retrieving a leader gene parameter from the leader gene and a 
corresponding leader gene parameter from the child gene; 

(c) producing a next generation gene parameter by computing a 
weighted average of the leader gene parameter and the child gene parameter, the 
weighting factor being based on the fitness value assigned to the child image 
associated with the child genotype; 

(d) storing the next generation gene parameter in a next generation 

gene; 

(e) repeating (b), (c), and (d) for all parameters included in the 
retrieved leader gene; 

(f) storing the resulting next generation gene in the next 
generation child genotype; and 

(g) repeating (a) through (f) for all genes included in the leader 

genotype. 

17. The computer-implemented method of Claim 16, v^4lerein evolving the 
next generation child genotypes also comprises mutating the recombined leader and 
child genotypes prior to the evolved next generation child genotypes being appUed to 
the leader image to produce a next generation child image. 

18. The computer-implemented method of Claim 17, wherein mutating the 
recombined leader and child genotypes comprises: 

(a) selecting a gene from the genotype; 

(b) determining a mutation rate for the gene; 

(c) using a random value to adjust the mutation rate; 

(d) applying the value of the adjusted mutation rate to the gene to 
produce a mutated gene; 

(e) storing the mutated gene in a mutated genotype; and 

(f) repeating (a) through (e) for all genes in the genotype. 

19. The computer-ii^plemented method of Claim 1, wherein the child 
genotypes include at least one gene for altering an attribute of the leader image when 
a child genotype is applied to the leader image to produce a child image. 
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20. The coiiiputer-inq)lemeated method of Claim 19, wherein the child 
genotypes include a global color shift gene for altering the global color of the leader 
image. 

21. The con^uter-implemented method of Claim 19, wherein the child 
genotypes include a color tenoperature gene for altering the color ten:q)erature of the 
leader image. 

22. The conq)uter-implemented method of Claim 19, wherein the child 
genotypes include a special effects gene for altering the leader image by introducing 
special effects into the leader image. 

23. The computer-in^lemented method of Claim 19, wherein the child 
genotypes include a blackpoint and whitepoint gene for altering the blackpoint and 
wiiitepoint of the leader image. 

24. The computer-irrplemented method of Claim 19, wherein the child 
genotypes include a brightness gene for altering the brightness of the leader image. 

25. The con:q)uter-implemented method of Claim 19, wherein the child 
genotypes include a contrast gene for altering the contrast of the leader image. 

26. The computer-inq)lemented method of Claim 19, wherein the child 
genotypes include a color saturation gene for altering the color saturation of the 
leader image. 

27. The conq)uter-ircq)lemented method of Claim 19, \?^erein the child 
genotypes include a black level adjustmmt gene for altering the black level of the 
leader image. 

28. The computer-ina5)lemented method of Claim 19, wherein the child 
genotypes include a selective color correction gene for selectively correcting the 
colors of the leader image. 

29. The computer-in^lemented method of Claim 1, wherein applying a 
child genotype to the leader image to produce a child image coixq)rises: 

obtairung a pixel from the leader image; 
obtaining a gene from the child genotype; 
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applying the gene to the pixel to produce a modified pixel; and 
storing the modified pixel in the child image. 

30. The computer-iirq)lemented method of Claim 29, wdierein applying the 
gene to the pixel to produce a modified pixel conq)rises: 

obtaining a parameter firom the gene; 

using the parameter as a weighting vahie to interpolate a gradation curve 
between a boimdary gradation curve associated with the gene and a neutral gradation 
curve; 

obtaining a color value firom the pixel; 

determining a new color value (y-coordinate) from the gradation curve by 
using the color value as the lookup value (x-coordinate); 

assigning the new color value to the modified pixel; and 
returning the modified pixel for inclusion in the child image. 

3 1 . The computer-implemented method of Claim 30, wherein the boundary 
gradation curve is chosen based on a second parameter of the gene. 

32. The concq)uter-incq)lemented method of Claim 30, wherein the color 
value comprises a plurality of color conq)onmt values and each of the color 
cortqionent values is modified by applying a gradation curve only if specified by 
another parameter of the gene. 

33. The computer-inq)lemented method of Claim 30, v^erein the boundary 
gradation curve is created by a support gene based on attributes of the image. 

34. The computer-implemented method of Claim 30, wherein the 
parameter of the gene is regulated by a regulator gene. 

35. The con:5)Uter-in]5)lemented method of Claim 34, wherein the regulator 
gene is weighted by a weighting value, the color value con^rises a plurality of color 
component values, and the weighting value is associated with a color component 
value. 

36. The con^uter-incplemented method of Claim 1, wiierein the child 
genotype is a predefined template gmotype. 

37. The con^>uter-implemented method of ClaioQ 1, fiuther conq)rising: 
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evolving a printer calibration genotype; and 

applying the printer calibration genotype to an image before it is printed by a 

printer. 

38. The con5)uter-in[q)lemented method of Claim 37, wherein evolving a 
printer calibration genotype conoprises: 

applying a plurality of genotypes to a digital image, the appUcation of each 
genotype producing a test unage; 
displaying each test image; 

printing each test image on a printed test page using the printer; 
receiving a selection of a best fit test image; and 

assigning as the printer calibration genotype the genotype that produced the 
best fit test image. 

39. The con:q)uter-in:q)lemented method of Claim 38, wherein evolving the 
printer calibration genotype iacludes determining the most fit gray scale genotype by: 

applying a pluraHty of gray-scale genotypes to a gray-scale dominant digital 
image to produce a pluraHty of gray scale dominant test images, each gray scale 
genotype having an associated gray scale genotype; 

displaying the gray scale dominant test images; 

printing the gray scale dominant test images on a printed test page using the 

printer; 

receiving a selection of the most fit gray scale dominant test image; and 
assigning the associated gray scale genotype of the most fit gray scale 
dominant test image as the printer gray scale genotype. 

40. The computer-in5)lemented method of Claim 39, wherem evolving the 
printer caUbration genotype also includes determining the most fit red-dominant scale 
genotype by; 

applying the printer gray scale genotype to a red-dominant digital image to 
produce a gray scale adjusted test image; 

applying a plurality of red-dominant genotypes to a red-dominant digital image 
to produce a plurality of red-dominant test images, each red-dominant genotype 
having an associated red-dominant genotype; 

displaying the red-dominant test images; 

printing the red-dominant test images on a printed test page using the printer; 
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receiving a selection of the most fit red-dominant test image; and 
assigning the associated red-dominant genotype of the most fit red-dominant 
test image as the printer gray scale genotype. 

41. The conq)uter-in:q)lemented method of Claim 40, wherein evolving the 
printer calibration genotype also includes determining the most fit green-dominant 
scale genotype by: 

applying the printer gray scale genotype to a green-dominant digital image to 
produce a gray scale adjusted test image; 

appl>Tng a plm-ality of green-dominant genotypes to a green-dominant digital 
image to produce a plurality of green-dominant test images, each green-dominant 
genotype having an associated green-dominant genotype; 

displaying the green-dominant test images; 

printing the green-dominant images on a printed test page using the printer; 
receiving a selection of the most fit green-dominant test image; and 
assigning the associated green-dominant genotype of the most fit green- 
dominant test image as the printer gray scale genotype. 

42. The conq)uter-inq)lemented method of Claim 40, wherein evolving the 
printer calibration genotype also includes determining the most fit blue-dominant scale 
genotype by: 

applying the printer gray scale genotype to a blue-dominant digital image to 
produce a gray scale adjusted test image; 

applying a plurality of blue-dominant genotypes to a blue-dominant digital 
image to produce a plitrahty of blue-dominant test images, each blue-dominant 
genotype having an associated blue-dominant genotype; 

displaying the blue-dominant test images on the video display; 

printing the blue-dominant test images on a printed test page using the printer; 

receiving a selection of the most fit blue dominant test image; and 

assigning the associated blue-dominant genotype of the most fit blue-dominant 
test image as the printer gray scale genotype. 

43. The conq)uter-iiiq)lemented method of Claim 42, wherein evolving the 
printer combination genotype also includes recombining the printer gray scale 
genotype, the printer red-dominant genotype, the printer green-dominant genotype, 
and the printer blue-dominant genotype to form the printer caUbration genotype. 
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44. The conq)uter-iirq)lemented method of Claim 38, wherein evolving the 
printer calibration genotype also includes determining the most fit red-dominant scale 
genotype by: 

applying the printer gray scale gmotype to a red-dominant digital image to 
produce a gray scale adjusted test image; 

applying a plurality of red-dominant genotypes to a red-dominant digital image 
to produce a pluraKty of red-domiaant test images, each red-dominant genotype 
having an associated red-dominant genotype; 

displaying the red-dominant test images; 

printing the red-dominant test images on a printed test page using the printer; 
receiving a selection of the most fit red-dominant test image; and 
assigning the associated red-dominant genotype of the most fit red-dominant 
test image as the printer gray scale genotype. 

45. The conq)uter-iii5)lemented method of Claim 38, wherein evolving the 
printer calibration genotype also includes determining the most fit green-dominant 
scale genotype by: 

applying the printer gray scale genotype to a green-dominant digital image to 
produce a gray scale adjusted test image; 

applying a plurality of green-dominant genotypes to a green-dominant digital 
image to produce a plurality of green-dominant test images, each green-dominant 
genotype having an associated green-dominant genotype; 

displaying the green-dominant test images; 

printing the green-dominant images on a printed test page using the printer; 
receiving a selection of the most fit green-dominant test image; and 
assigning the associated green- dominant genotype of the most fit green- 
dominant test image as the printer gray scale genotype. 

46. The con^)uter-inq)lemented method of Claim 38, wherein evolving the 
printer calibration genotype also includes determining the most fit blue-dominant scale 
genotype by: 

applying the printer gray scale genotype to a blue-dominant digital image to 
produce a gray scale adjusted test image; 

applying a pluraUty of blue-dominant genotypes to a blue-dominant digital 
image to produce a plurality of blue-dominant test images, each blue-dominant 
genotype having an associated blue-dominant genotype; 
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displaying the blue-dominant test images on the video display; 
printing the blue-dominant test images on a printed test page using the printer; 
receiving a selection of the most fit blue dominant test image; and 
assigning the associated blue-dominant genotype of the most fit blue-dominant 
test image as the printer gray scale genotype. 

47. A computer-readable medium containing computer-executable 
instructions for carrying out the computer-inq)lemented method recited in any one of 
Claims 1-47. 
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^ MAIN ^ 



IMPORT PARENT IMAGE 
AND TRANSLATE TO RED, 
GREEN, AND BLUE (RGB) 
VALUES FOR EACH PIXEL 



510 




512 



PERFORM EVOLUTION 
(FIGURE 6) 



514 



PERFORM APPLY 
GENOTYPE TO AN 
IMAGE USING THE 
TEMPLATE GENOTYPE 
(FIGURE 11) 



516 



NO 



PERFORM IMAGE 
DEWARP 
(FIGURE 22) 



518 



PERFORM CALIBRATE 
PRINTER 
(FIGURE 23) 



Fig.5. 
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Q 
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EVOLUTION 



512 



SETA LEADER GENOTYPE TO A 
NEUTRAL GENOTYPE. 



612 




-YES—, 



NO 



SELECTA 
PLURALITY OF 
PREDEFINED 
GENOTYPES AS 
CHILD GENOTYPES 



624 



622 



RECOMBINE THE 

LEADER 
GENOTYPE WITH 
THE CHILD 
GENOTYPE 
HAVING THE 
HIGHEST 
FITNESS RATING 
TO PRODUCE A 
(NEW) LEADER 
GENOTYPE. 
(HGURE 8) 



616 



EVOLVE THE NEXT 
GENERATION (FIGURE 7) 
OF CHILD GENOTYPES 
FROM FROM THE 
LEADER GENOTYPE 
USING EACH OF THE 
CURRENT CHILD 
GENOTYPES 



APPLY EACH OF THE 

PREDEFINED 
GENOTYPES TO THE 
LEADER IMAGE TO 
PRODUCE A CHILD 
IMAGE FOR EACH 
CHILD GENOTYPE. 
(FIGURE 11) 



618 



DISPLAY THE IMAGES 
AND RECEIVE FTTNESS 
RATING OF CHILD 
IMAGES 
(FIGURE 4) 



-NO 




620 



Fig.6. 
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710 




EVOLVE NEXT GENERATION 



0 



RECOMBINE 
LEADER GENOTYPE WTTHA CHILD GENOTYPE 
INTO A NEXT GENERATION CHILD GENOTYPE 

(FIGURE 8) 



712 



MUTATE 

NEXT GENERATION CHILD GENOTYPE 
(HGURE 10) 



714 



APPLY THE NEXT GENERATION CHILD 
GENOTYPE TO THE IMAGE TO PRODUCE A 
NEXT GENERATION CHILD IMAGE 
(FIGURE 11) 



YES 



716 



ASSOCIATE THE NEXT GENERATION CHILD 
GENOTYPE WTTH THE NEXT 
GENERATION CHILD IMAGE 




718 



720 



RETURN ALL NEXT GENERATION CHILD 
IMAGES (AND ASSOCIATED NEXT GENERATION 
CHILD GENOTYPES) AS A CHILD IMAGES (AND 
ASSOCIATED CHILD GENOTYPES). 



722 



DONE 




724 



Fig.7. 
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RECOMBINE GENOTYPES 




810 



RETRIEVE A LEADER GENOTYPE 


^ 


r 


RETRIEVE ACE 


ILD GENOTYPE 





RECOMBINE GENES OF LEADER 
GENOTYPE AND CHILD GENOTYPE INTO 
A NEXT GENERATION GENOTYPE 
(FIGURE 9) 



818 



812 



814 



816 



'ANOTHER^ 
CHILD GENOTYPE^ 
JTO PROCESS^ 

7 



RETURN ALL THE NEXT GENERATION 
GENOTYPES AS THE CHILD GENOTYPES 



822 




DONE 



820 



Fig.8. 
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c 



lom 

RECOMBINE LEADER GENOTYPE 
WITH A CHILD GENOTYPE 




910 



912 



RETRIEVE A LEADER GENE FROM THE LEADER 
GENOTYPE AND A CORRESPONDING CHILD GENE 
FROM THE CHILD GENOTYPE 



914 



RETRIEVE A LEADER GENE PARAMETER FROM THE 
LEADER GENE AND A CORRESPONDING CHILD GENE 
PARAMETER FROM THE CHILD GENE 



PRODUCE A NEXT GENERATION GENE PARAMETER BY 
COMPUTING A WEIGHTED AVERAGE OF THE LEADER 
GENE PARAMETER AND THE CHILD GENE 
PARAMETER, THE WEIGHTING FACTOR EQUALING 
THE FITNESS PARAMETER ASSIGNED TO 
THE CHILD GENOTYPE, 



916 



918 



YES 



STORE THE NEXT GENERATION GENE PARAMETER 
IN A NEXT GENERATION GENE. 



YES 




920 



NO 



922 



STORE THE NEXT GENERATION GENE IN THE 
NEXT GENERATION GENOTYPE. 



Fig.9. 




926 
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YES 



iim 



MUTATE GENOTYPE 



1010 



1012 



RETRIEVE NEXT GENE 
IN GENOTYPE 



RETRIEVE THE MmPATION RATE 
FOR THE GENE FROM A MUTATIONl 
RATE TABLE (FIGURE lOB.) USING 
THE NUMBER OF THE CURRENT 
GENERATION FOR THE COLUMN 
AND THE GENE ?mMBER FOR THE 

ROW. (IF THE NUMBER OF 
GENERATIONS IN THE TABLE HAVE 
BEEN EXCEEDED, USE THE VALUE 
FROM THE LAST GENERATION). 



1016 





r 


MULTIPLY THE MUTATION RATE 
BY A GUASS-RANDOM VALUE TO 
PRODUCE A MUTATION VALUE. 






ADD THE MUTATION VALUE TO 
THE GENE TO PRODUCE A 
MUTATED GENE. 




r 


STORE THE MUl 
MUTATED 


ATEDGENEINA 
GENOTYPE. 



1022 



1024 




1026 



Fig.lOA. 



RETURN 
MUTATED 
GENOTYPE AS 

NEXT 
GENERATION 
GENOTYPE. 



1032 



1034 



DONEJ 
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ex) 
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be 
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APPLY A GENOTYPE 
TO AN IMAGE 



I 




RETRIEVE THE CURRENTLY 
LOADED IMAGE. 



RETRIEVE THE GENOTYPE TO 

BE APPLIED TO THE 
CURRENTLY LOADED IMAGE 



13/44 
1110 

1112 



1114 



RETRIEVE A PIXEL 
FROM THE CURRENTLY 
LOADED IMAGE 



1 



1116 



1118 



RETRIEVE A GENE 
FROM THE GENOTYPE 



YES 



APPLY THE GENE FROM THE 
GENOTYPE TO THE PIXEL 
TO OBTAIN NEW PIXEL 
(FIGURES 12A - 21.) 



1120 



YES 




1122 



Fig.ll, 



1128 



STORE THE NEW PIXEL 
IN A CHILD IMAGE 




1136 



NO-^ 



RETURN THE CHILD IMAGE 
AND THE ASSOCIATED 
GENOTYPE. 



1138 



1134 



c 



DONE 
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GENEl: GLOBAL 
COLOR SHIFT 




1210 



Fig.llA. 




USING LEADER GENOTYPE GENE 1, 

SECOND PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW RED 

GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSmVE GLOBAL COLOR SHIFT 
GRADATION CURVE (FIGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE 12F). 



USING LEADER GENOTYPE GENE 1, 

SECOND PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW RED 
GLOBAL COLOR SHIFT GRADATION 

CURVE BETWEEN THE NEGATIVE 
GLOBAL COLOR SHIFT GRADATION 
CURVE (FIGURE 12E) AND THE 
NEUTRAL GRADATION CURVE 
(FIGURE 12F). 



NO 




USING LEADER GENOTYPE GENE 1, 
THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW 
GREEN GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSmVE GLOBAL COLOR SHffT 
GRADATION CURVE (HGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE 12F). 



USING LEADER GENOTYPE GENE 1, 
THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW 
GREEN GLOBAL COLOR SHLFT 
GRADATION CURVE BETWEEN THE 
NEGATIVE GLOBAL COLOR SHIFT 
GRADATION CURVE (FIGURE 12E) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE 12F). 



0- 



ASSIGN THE NUETRAL GRADATION 

CURVE TO A NEW BLUE GLOBAL 
COLOR SHIFT GRADATION CURVE 



1233 
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Fig.UB. 




USING LEAnER GENOTYPE GENE 1, 
SECOND PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW 
GREEN GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSITIVE GLOBAL COLOR SHIFT 
GRADATION CURVE (FIGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (HGURE 12F). 



USING LEADER GENOTYPE GENE 1, 
SECOND PARAAilETER AS THE X 
VALUE, INTERPOLATE A NEW 
GREEN GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
NEGATIVE GLOBAL COLOR SHIFT 
GRADATION CURVE (HGURE 12E) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE UF). 



NO 




USING LEADER GENOTYPE GENE 1, 

THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW BLUE 

GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSITIVE GLOBAL COLOR SHIFT 
GRADATION CURVE (FIGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (HGURE 12F). 



USING LEADER GENOTYPE GENE 1, 

THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW BLUE 
GLOBAL COLOR SHIFT GRADATION 

CURVE BETWEEN THE NEGATIVE 
GLOBAL COLOR SHIFT GRADATION 
CURVE (FIGURE HE) AND THE 
NEUTRAL GRADATION CURVE 
(FIGURE 12F). 



1 



1257 



ASSIGN THE NUETRAL GRADATION 

CURVE TO A NEW RED GLOBAL 
COLOR SHIFT GRADATION CURVE 
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USING LEADER GENOTYPE GENE 1, 

SECOND PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW RED 

GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSmVE GLOBAL COLOR SHIFT 
GRADATION CURVE (HGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE 12F). 



USING LEADER GENOTYPE GENE 1, 

SECOND PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW RED 
GLOBAL COLOR SHIFT GRADATION 

CURVE BETWEEN THE NEGATIVE 
GLOBAL COLOR SHIFT GRADATION 
CURVE (FIGURE HE) AND THE 
NEUTRAL GRADATION CURVE 
(FIGURE 12F). 



NO 




USING LEADER GENOTYPE GENE 1, 

THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW BLUE 

GLOBAL COLOR SHIFT 
GRADATION CURVE BETWEEN THE 
POSITIVE GLOBAL COLOR SHIFT 
GRADATION CURVE (FIGURE 12D) 
AND THE NEUTRAL GRADATION 
CURVE (FIGURE 12F). 



1280 



USING LEADER GENOTYPE GENE 1, 

THIRD PARAMETER AS THE X 
VALUE, INTERPOLATE A NEW BLUE 
GLOBAL COLOR SHIFT GRADATIOhH 

CURVE BETWEEN THE NEGATIVE 
GLOBAL COLOR SHIFT GRADATIOhl\ 
CURVE (FIGURE 12E) AND THE 
NEUTRAL GRADATION CURVE 
(FIGURE 12F). 



DONE 



U79 



ASSIGN THE NUETRAL GRADATION 
CURVE TO A NEW GREEN GLOBAL 
COLOR SHIFT GRADATION CURVE 
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GENE 2: COLOR 
TEMPERATURE 



1312s^ 




1310 



USING THE GENE 2 PARAMETER AS THE WEIGHT VALUE, 
COMPUTE A RED COLOR TEMPERATURE GRADUATION 
CURVE ("RTEMP") BY WEIGHTED INTERPOLATION 
BETWEEN A LOW TEMPERATURE RED BOUNDARY 
GRADATION CURVE (FIGURE 13B) AND THE NEUTRAL 
GRADATION CURVE (FIGURE 12F) 



131 



USING THE GENE 2 PARAMETER AS THE WEIGHT VALUE, 
COMPUTE A GREEN COLOR TEMPERATURE GRADUATION 
CURVE ("GTEMP") BY WEIGHTED INTERPOLATION 
BETWEEN A LOW TEMPERATURE GREEN BOUNDARY 
GRADATION CURVE (HGURE 13C) AND THE NEUTRAL 
GRADATION CURVE (FIGURE 12F) 



1316k 



USING THE GENE 2 PARAMETER AS THE WEIGHT VALUE, 
COMPUTE A BLUE COLOR TEMPERATURE GRADUATION 
CURVE ("BTEMP") BY WEIGHTED INTERPOLATION 
BETWEEN A LOW TEMPERATURE BLUE BOUNDARY 
GRADATION CURVE (FIGURE 13D) AND THE NEUTRAL 
GRADATION CURVE (FIGURE 12F) 



YES 



1320 



FIND A LOW 
TEMPERATURE 
VALUE FOR RG&B 
R = RTEMPIX] 
G = GTEMPpa 
B = BTEMP[XJ 




NO 



RETURN THE NEW 
RGB VALUES AS A 
NEW PIXEL FOR 
THE CHILD IMAGE 



1326 




1322 



FIND A HIGH 
TEMPERATURE VALUE 

FOR RG&B 
R = X-(RTEMPPQ - X) 
G = X - (GTEMPDQ - X) 
B = X- (BTEMPIXI - X) 



Fig.l3A. 



wo 00/33207 



PC7r/US99/28676 




wo 00/33207 



PCT/US99/28676 



24J44 




A FIRST PARAMETER SPECIFIES A 
PREDEFINED GRADATION CURVE DEFINING 
AN EFFECT TO THE RED COMPONENT (E.G., 
AN "INVERSE" GRADATION CURVE MAY 
HAVE THE EQUATION: Y = 255-X) 



A SECOND PARAMETER SPECIHES A 
PREDEFINED GRADATION CURVE DEFINING 
AN EFFECT TO THE GREEN COMPONENT 
(E.G., AN "INVERSE" GRADATION CURVE 
MAY HAVE THE EQUATION: Y= 255-X) 



1412 



1414 



A THIRD PARAMETER SPECIFIES A 
PREDEFINED GRADATION CURVE DEFINING 

AN EFFECT TO THE BLUE COMPONENT 
(E.G., A "NEUTRAL GRADATION CURVE MAYl 
HAVE THE EQUATION: Y = X) 



1416 



1418 




Fig.14. 
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c 



GENE 8: BLACKPOINT 
AND WHITEPOINT 




1510 



^ 


f 


DETERAUNE BRIGHTEST COLOR 
TONE IN THE IMAGE 
(WHITEPOINT). 




r 


DETERMINE THE DARKEST COLOR 
TONE IN THE IMAGE 
(BLACKPOINT). 




r 


COMPUTE A LINEAR BLACKPOINT 
AND WHTTEPOINT GRADATION 
CURVE USING THE POINTS (0, 
WHITEPOINT) AND (255, 
BLACKPOINT). 




^1518 
f 1 



1512 



1514 



1516 



DONE 




Fig.lSA. 
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1610 




Fig.l6A. 



NO 



INTERPOLATE A BRIGHTNESS GRADATION 
CURVE BETWEEN A POSITIVE BRIGHTNESS/ 

COLOR SATURATION BOUNDARY 
GRADATION CURVE (FIGURE 16B) AND THE 
NEUTRAL GRADATION CURVE (FIGURE 12F) 
USING THE VALUE OF THE GENE 4 
PARAMETER AS THE WEIGHT VALUE IN A 
WEIGHTED INTERPOLATION. 



1618 



1616 



INTERPOLATE A BRIGHTNESS GRADATION 
CURVE BETWEEN A NEGATIVE BRIGHTNESS/ 

COLOR SATURATION BOUNDARY 
GRADATION CURVE (FIGURE 16C) AND THE 
NEUTRAL GRADATION CURVE (FIGURE 12F) 
USING THE VALUE OF THE GENE 4 
PARAMETER AS THE WEIGHT VALUE IN A 
WEIGHTED INTERPOLATION. 



DONE 



> 
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GENE 5; CONTRAST 




1710 





r 


RETRIEVE THE CONTRAST PARAMETER OF GENE 5. 




f 


USING THE CONTRAST PARAMETER AS THE WEIGHT 
VALUE IN A WEIGHTED INTERPOLATION, INTERPOLATE 
A NEW GRADATION CURVE USING THE GRADATION 
CURVE FROM GENE 9 (HGUKE 21) AND A NEUTRAL 
GRADATION CURVE (FIGURE 12F). 




r 


DETERMINE A NEW CONTRAST VALUE FROM THE NEW 
CONTRAST GRADATION CURVE FOR EACH OF 
THE RGB VALUES OF THE PIXEL 


1718 


r 



-1712 



1716 



DONE 



Fig.l7. 
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GENE 6: COLOR SATURATION ^ 



1814- 



TRANSLATE THE ADDTTIVE PRIMARY COLOR VALUES TO 
THE EQUIVALENT SUBTRACTIVE PRIMARY COLORS 

/" E * 

C (CYAN) = 255 - R (RED) 
M (MAGENTA) =255 - G (GREEN) 
Y (YELLOW) = 255-3 (BLUE)] 



1816- 



1818- 



DETERMINE THE BLACK (K) LEVEL [K = MIN(C,M,Y)] 



TEMPORARILY REMOVE THE BLACK LEVEL OF THE 
SUBrRACnVE PRIMARY COLORS 
[c (CYAN) = C-K 
m (MAGENTA) = M-K 
y (YELLOW) =Y-K] 



1820- 



ADPIST THE SUBTRACTIVE PRIMARY COLORS USING THE 
COLOR SATURATION GRADATION CURVES WEIGHTED 
BY THE PARAMETER OF THIS GENE 
(FIGURES 16B AND 16C) 



1822- 



ADD THE BLACK LEVEL BACK INTO THE 
SUBTRACTIVE PRIMARY COLORS 
[C = c+K 
M = m+K 
Y=y + K] 



1824- 



TRANSLATE THE SUBTRACTIVE PRIMARY 
COLOR VALUES TO THE EQUIVALENT 
ADDITIVE PRIMARY COLORS 
[E.G.: 
R = 255-C 
G = 255-M 
B = 255-Y] 



1826- 



RETURN THE NEW ADDITIVE 
PRIMARY VALUES (RGB) AS A NEW 
PIXEL IN THE CHILD IMAGE. 



1830 




DONE 



Fig.lS. 
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GENE 7A: ADJUSTMENT OF BLACK 
LEVEL IN PRIMARY COLORS 



1912 





1910 





r 


RETRIEVE RGB VALUE FROM THE PIXEL 



191 



TRANSLATE THE ADDITIVE PRIMARY COLOR VALUES TO 
THE EQUIVALENT SUBTRACTIVE PRIMARY COLORS 

[E.G.: 

C (CYAN) = 255-R (RED) 
M (MAGENTA) =255 - G (GREEN) 
Y (YELLOW) = 255 - B (BLUE)] 



1916 



1918 



DETERMINE THE BLACK (K) LEVEL 
[K = MIN(C,M,y)] 



TEMPORARILY REMOVE THE BLACK LEVEL OF THE 
SUBTRACTIVE PRIMARY COLORS 
[C (CYAN) = C-K 
M (MAGENTA) = M-K 
Y (YELLOW) = Y-K] 

i 



1920 



COMPUTE AN INTERMEDIATE COLOR SEPARATION 
B' (BLUE) =MIN(CM) 
R' (RED) =MIN(M,Y) 
G' (GREEN) =MIN(CrY) 
C (CYAN) =C-(G'+B'> 
M' (MAGENTA) =M-(R'+B') 
Y' (YELLOW) =y-(R'+G'> 



1922 



APPLY THE GRADUATION CURVE (HGURE 19C) TO EACH OF THESE COLORS 

B7(BLUE) =CURVE1[B'] 
R7(RED) =CURVE1[R'] 
G7(GREEN) =CURVE1[G'] 
C7(CYAN) =CURVE1[C'] 
M7(MAGENTA) =CURVE1[M1 
Y7(YELLOV^ = CURVE1[Y'] 



EACH INTERMEDIATE SEPARATION VALUE IS ADJUSTED BY APPLYING A 
CORRESPONDING GENE PARAMETER FROM GENE 7 A. 

B7 (BLUE) = (B7* G1*)I127 
R7 (RED) = (R7* G2*)/127 
G7 (GREEN) = (G7* G3*)I127 
C7 (CYAN) = (C7* G4*)/127 
M7 (MAGENTA) = (M7* G5*)I127 
Y7 (YELLOW) = (Y7* G6*R)/127 



Fig.l9A. 



1924 
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1928 



33/44 



DETERMINE A BLACK LEVEL CORRECTION FACTOR 
FROM A PREDEFINED CURVE (KFCURVE) 
KF = KFCURVE [K] 
(FIGURE 19D) 



COMPUTE A BLACK LEVEL CORRECTION FOR EACH PRIMARY COLOR 

C"= KF*C7/256 
M"= KF*M7/256 
Y"= KF*Y7/256 
R"= KF*R7I256 
G"=KF*G7/256 
B"= KF*B7/256 



1930>^ 



ENHANCE EACH COLOR WITH THE BLACK LEVEL CORRECTION 

C'=C'+C" 
M'=M'+M" 

y'=Y'+Y' 

R'=R'+R" 
G'=G'+G" 
B'=B'+B" 



1932-^ 



ENHANCE BLACK LEVEL WTTH THE BLACK LEVEL CORRECTION 

K=K-C"-M"-Y"-R"-G"-B" 



1934-^ 



CALCULATE THE BLACK ENHANCED RGB VALUE FOR THE PIXEL. 

C=C'+B'+G' + K 
M = M'+R'+B'+K 
Y=Y'+R'+G' + K 

R = 255-C 
G = 255-M 
B = 255-Y 



1936' 



I 



RETURN THE NEW RGB VALUES 
AS A NEW PIXEL FOR THE CHILD 



1938 



Fig.l9B. 




NO 
1 



DONE 
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GENE7B: SELECTIVE COLOR 
CORRECTION 




2010 



2012 



RECEIVE THE RGB VALUES OF A PIXEL 



2014 



TRANSLATE THE ADDITIVE PRIMARY COLOR VALUES TO THE 
EQmVALENT SUBTRACTIVE PRIMARY COLORS 

[EG' 

C (CYAN) = 255-R (RED) 
M (MAGENTA) =255 - G (GREEN) 
Y (YELLOV/) = 255 - B (BLUE)] 



2018 



DETERMINE THE BLACK (K) LEVEL 
[ K = MIN(CM,Y)] 



■2016 



TEMPORARILY REMOVE THE BLACK LEVEL OF THE 
SUBTRACTIVE PRIMARY COLORS 
[C (CYAN) = C-K 
M (MAGENTA) = M-K 
Y (YELLOW) = Y-K] 



202 




COMPUTE AN INTERMEDIATE COLOR SEPARATION 
B' (BLUE) =MIN(CM) 
R' (RED) =MIN(M,Y) 
G' (GREEN) =MIN(C,Y) 
a (CYAN) =C-(G'+B') 
M' (MAGENTA) =M-(R'+B') 
Y' (YELLOW) =Y-(R'+G') 



FOR EACH OF THE PRIMARY COLORS CMYRGB, RETRIEVE 3 
PARAMETERS: AN AMPUFICATION FACTOR FOR THAT PRIMARY 

COLOR, AN AMPLIFICATION FACTOR FOR THE CLOCKWISE 
ADJACENT COLOR (FIGURE 2B) AND AN AMPLIFICATION FACTOR 
FOR THE COUNTERCLOCKWISE ADJACENT COLOR (FIGURE 2B) 



Fig.20A. 




2022 
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2024 




2028 



USING A SPLINE ALGORITHM, COMPUTE A 
GRADATION CURVE FOR THE COLOR AND 
THE TWO ADJACENT COLORS USING THE 
FOLLOWING POINTS: 

(0,0)(XPOINT, YPOINT), (255,255) WHERE: 
XPOINT= 655361 AMPLIFICATION FACTOR 
Y POINT = XPOINT IF XPOINT <230 OR 
XPOINT = 230 IF XPOINT>230 
THIS RESULTS IN 18 GRADATION CURVES 
(THREE FOR EACH COLOR EXCEPT BLACK): 

BBCORRIJ BLUECORRECnON FOR BLUE 
BCCORRD CYANCORRECnON FOR BLUE 
BMCORR[] MAGENTACORRECTION FOR 

BLUE 

MMCORRO MAGENTA CORRECTION FOR 

MAGENTA 
MBCORRD BLUECORRECnON FOR 

MAGENTA 

MRCORRD REDCORRECnON FOR MAGENTA 

RRCORRD REDCORRECJIONFORRED 
RMCORRD MAGENTACORRECTION FOR RED 
RYCORRO YELLOWCORRECnONFORRED 



YYCORRH 

YRCORRO 
YGCORRD 



GGCORRD 
GYCORRD 

GCCORRD 

CCCORRO 
CGCORRD 
CBCORRD 



YELLOWCORRECnON FOR 
YELLOW 
REDCORRECnON FOR YELLOW 
GREENCORRECnON FOR 
YELLOW 

GREENCORRECTIONFOR GREEN 
YELLOWCORRECTION FOR 
GREEN 

CYANCORRECTION FOR GREEN 

CYANCORRECnON FOR CYAN 
GREENCORRECTIONFOR CYAN 
BLUECORRECnON FOR CYAN 



USING A THE 
CORRESPONDING 
GRADATION CURVE, 
SELECTIVELY CORRECT 
THE PRIMARY COLORS: 

B'= BBCORR[Bl 
C'=BCCORR[B'] 
M'=BMCORR[B'] 

M' = MMCORRIMI 
B' = MBCORRIM'] 
R' = MRCORRIM'] 

R' = RRCORRIRI 
M' = RMCORR[Rl 
Y' = RYCORRlRn 

Y' = YYCORRIY'} 
R' = YRCORRIYI 
G' = YGCORMYl 

G' = GGCORRIGI 
Y' = GYCORRIG'] 
C = GCCORRIGI 

C = CCCORR[Cl 
G' = CGCORRIC] 
B' = CBCORR[C'] 



Fig.20B. 



0 
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0 



2030 



COMPUTE THE RGB VALUES TO RETURN: 

R=R'+M'+Y'+K 
G=G'+C'+y'+K 
B=B'+C'+M'+K 



I 

Q DONE J 



Fig.20C. 
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GENE 9: CONmAST GRADATION 




2110 



CONVERT EACH PIXEL INTO GRAY 



V 



2112 



CREATE A HISTOGRAM WTTH EVERY GRAY TONE IN THE 
GRAY SCALE COPY OF THE IMAGE ON THE X-AXIS AND 
THE FREQUENCY THAT THE GRAY TONE 
APPEARS IN THE IMAGE ON THE Y-AXIS. 
(FIGURE 21B) 



■2114 



STARTING AT THE ENDPOINT OF THE HISTOGRAM ON 
THE X-AXIS NEAREST THE ORIGIN, INTEGRATE THE AREA 
DEFINED BY THE HISTOGRAM AWAY FROM THE ORIGIN 
UNTIL 2% OF THE TOTAL AREA OF THE HISTOGRAM IS 
REACHED. RECORD THE X-AXIS VALUE AT THIS 
POINT AS A FIRST PARAMETER (A) OF GENE 9. 
(FIGURE 21B> 



2116 



STARTING AT THE ENDPOINT OF THE HISTOGRAM ON 
THE X-AXIS FURTHEST FROM THE ORIGIN, INTEGRATE 
THE AREA DEFINED BY THE HISTOGRAM TOWARD THE 

ORIGIN UNTIL 2% OF THE TOTAL AREA OF THE 
HISTOGRAM IS REACHED. RECORD THE X-AXIS VALUE 
AT THIS POINT AS A SECOND PARAMETER (B) OF GENE 9. 

(FIGURE 21B) 



-2118 



USING SPLINE INTERPOLATION, CALCULATE A S-SHAPED 
CONTRAST GRADATION CURVE USING THE POINTS (0,0) 
AND (255, 255) AS THE END POINTS AND 
(A,12), (B,242) AS THE INFLECTION POINTS. 
(nGURE21C) 



-2120 



DONE 




2122 



Fig.21A. 
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2210 



2212 



2214 



2216 




DEWARP 



RETRIEVE PREDEFINED 
CORRECTION COEFFICIENTS A, B, C 



DETERAONE A FOCAL POINT IN 
THE PARENT IMAGE 



RETRIEVE A PIXEL AND ITS 
LOCATION FROM THE 
PARENT IMAGE 



2218 



DETERMINE A VECTOREDRADIUS 
BETWEEN THE LOCATION OF THE 
PIXEL AND THE FOCAL POINT 



2220 



I 



USING BI-CUBIC INTERPOLATION, 
DETERMINE A NEW VECTORED 
RADIUS FOR THE PIXEL 

KNEW = AR + B*R^3 + C*R'^5 



2222 






r 


STORE THE 1 
CHILD IMAGl 
VECTORE 


^IXELINTHE 
zATTHENEW 
D RADIUS 



NO 



2224 
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PRINTER CALIBRATION 

i — 



RETRIEVE A GRAY SCALE IMAGE 



Fig.23A. 



APPLY (FIGURE 11) A GRAY SCALE TEMPLATE 
GENOTYPE TO THE GRAY SCALE IMAGE TO CREATE 

A TEST IMAGE [THE GRAY SCALE TEMPLATE 
GENOTYPE IS NEUTRAL OTHER THAN BRIGHTNESS 
(GENE 4) AND CONTRAST (GENE5)] 



■2314 



YES 




2318 



DISPLAY EACH TEST IMAGE ON A DISPLAY 



'2320 



PRINT EACH TEST IMAGE ON A PRINTED TEST PAGE USING THE 
PRINTER TO BE CALIBRATED. THE TEST IMAGES SHOULD BE 
ARRANGED AS THEY ARE DISPLAYED ON THE DISPLAY 



A USER CHOOSES THE "BEST" TEST IMAGE APPEARING ON A 
PRINTED TEST PAGE AND SELECTS THE CORRESPONDING TEST 
IMAGE ON THE DISPLAY. THE GENOTYPE OF THE SELECTED TEST 
IMAGE IS ASSIGNED AS A PRINTER GRAY SCALE GENOTYPE. 




2322 



'2324 



RETRIEVE A RED-DOMINANT TEST IMAGE 



APPLY CPIGURE 11) THE PRINTER GRAY SCALE GENOTYPE TO 
THE RED-DOMINANT TEST IMAGE TO CREATE A GRAY SCALE 

ADJUSTED TEST IMAGE 



'2326 



APPLY (FIGURE II) A RED-DOMINANT TEMPLATE 
GENOTYPE TO THE GRAY SCALE ADJUSTED TEST 
IMAGE TO CREATE A RED-DOMINANT TEST IMAGE 



'2328 



2330 



YES 



PREPARE 
ANOTHER RED- 
DOMINANT TEST IMAGE 
USING A DIFFERENT RED- 
)OMINANT TEMPLA1 
GENOTYPE 

7 



-NO 
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Fig.23B. 



43m 



2332 



RETRIEVE A GREEN-DOMINANT TEST IMAGER 

I 



2334 



APPLY (FIGURE 11) THE PRINTER GRAY SCALE GENOTYPE TO 
THEGREEN-DOMINANT TEST IMAGE TO CREATE A GRAY 
SCALE ADJUSTED TEST IMAGE 



APPLY (FIGURE 11) A GREEN-DOMINANT TEMPLATE 
GENOTYPE TO THE GRAY SCALE ADJUSTED TEST IMAGE TO 
CREATE A GREEN-DOMINAm' TEST IMAGE 



2338 



2336 



YES 



PREPARE 
^ANOTHER GREEN- 
ttOMJNANT TEST IMAGl 
USING A DIFFERENT 
GREEN-DOMINANT 
TEMPLATE 
GENOTYPE 



2340 



RETRIEVE A BLUE-DOMINANT TEST IMAGE 



2342 



APPLY (FIGURE 11) THE PRINTER GRAY SCALE GENOTYPE TO 
THE BLUE-DOMINANT TEST IMAGE TO CREATE A GRAY 
SCALE ADJUSTED TEST IMAGE 



2344 



APPLY (FIGURE 11) A BLUE-DOMINANT TEMPLATE 
GENOTYPE TO THE GRAY SCALE ADJUSTED TEST IMAGE TO 
CREATE A BLUE-DOMINANT TEST IMAGE 



2346 
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2348 



Fig.23C. 



DISPLAY EACH RED-DOMINANT, GREEN-DOMINANT AND 
BLUE-DOMINANT TEST IMAGE ON THE VIDEO MONITOR 



2350 



PRINT EACH RED-DOMINANT, < 
DOMINANT TEST IMAGE ON A COLi 
PRINTER TO BE CALIBRATED. 
ARRANGED AS THEY ARE Dl 


3REEN-DOMINANTAND BLUE- 
OR TEST PRINTER PAGE FROM THE 
THE TEST IMAGES SHOULD BE 
ISPLAYED ON THE DISPLAY. 




2352 


THE USER CHOOSES THE "BEST" RED-DOMINANT TEST IMAGE 
APPEARING ON A PRINTED TEST PAGE AND SELECTS THE 
CORRESPONDING RED- DOMINANT TEST IMAGE ON THE DISPLAY. 
THE GENOTYPE OF THE SELECTED TEST IMAGE IS ASSIGNED AS THE 
PRINTER RED-DOMINANT GENOTYPE. 


^ 


2354 

r /" ^ 


THE USER CHOOSES THE "BEST" GREEN-DOMINANT TEST IMAGE 
APPEARING ON A PRINTED TEST PAGE AND SELECTS THE 
CORRESPONDING GREEN- DOMINANT TEST IMAGE ON THE DISPLAY. 
THE GENOTYPE OF THE SELECTED TEST IMAGE IS ASSIGNED AS THE 
PRINTER GREEN-DOMINANT GENOTYPE. 




2356 


THE USER CHOOSES THE "BEST" BLUE-DOMINANT TEST IMAGE 
APPEARING ON A PRINTED TEST PAGE AND SELECTS THE 
CORRESPONDING BLUE- DOMINANT TEST IMAGE ON THE DISPLAY. 
THE GENOTYPE OF THE SELECTED TEST IMAGE IS ASSIGNED AS THE 
PRINTER BLUE-DOMINANT GENOTYPE. 




2358 



RECOMBINE (FIGURE 8) THE PRINTER GRAY SCALE GENOTYPE, THE 
PRINTER RED-DOMINANT GENOTYPE, THE PRINTER GREEN-DOMINANl 
GENOTYPE AND THE PRINTER BLUE DOMINANT GENOTYPE TO FORMA 
PRINTER CALIBRATION GENOTYPE THAT IS SAVED AS A TEMPLATE 
GENOTYPE. [THE PRINTER CALIBRATION GENOTYPE CAN THEN BE 
APPLIED (FIGURE 11) TO CREATE A PRINT FILE SENT TO A PRINTER 
ASSOCIATED WITH THE PRINTER CALIBRATION GENOTYPE.] 



^ DONE 
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